Survey: IT leaders expect to move more more big-data jobs to Kubernetes
Pepperdata announced the results of a new survey to gauge the pace at which enterprises are migrating big data applications to Kubernetes containers. 600 senior enterprise IT professionals in industries ranging from finance, healthcare, automotive, telecommunications, retail and other data-intensive businesses were polled. Companies ranged from 500 employees to more than 5,000.
Kubernetes is the preferred container orchestration technology for its agility, speed and efficiency for scaling and managing apps and infrastructure. Because of this, 77% of respondents signaled their intent to migrate 50% or more of their big data applications to containers with Kubernetes by the end of the year. Applications that topped the list of those moving to Kubernetes include Spark, which was the most popular with 63% of the votes. Presto took 2nd with 45%, Kafka came in at 42%, and Trino scored 34%. Flink followed up with 27%.
The biggest challenges with containers and Kubernetes reported by those surveyed include:
- Allocation and reallocation of resources (30%)
- A lack of comprehensive visibility and monitoring tools (26%)
- Fragmentation in the Kubernetes marketplace (so many tools and opinions, 20%)
- Difficulty manually tuning Kubernetes (9%)
- Complexity and scaling (15%)
“The velocity of the shift to Kubernetes is surprising. It’s gratifying to see big data move to Kubernetes with this speed. It’s clear that this shift will create optimization challenges as customers understand the nuances of running within the Kubernetes environment,” said Ash Munshi, CEO, Pepperdata. “Pepperdata is uniquely positioned to help customers moving to Kubernetes maximize resource utilization while controlling costs.”
When asked what their goals were for migrating to containers, respondents were split. 45% want an increase in application performance and stability. 27% said flexibility and portability of workloads; and 18% want to decrease costs. 10% said they wanted a multi-cloud solution to keep from being locked into one cloud vendor.
