
Big Data Engineering Leader
8 hours ago
Job Title: Big Data Engineering Leader
Location: Shivamogga, India
We are seeking a highly experienced leader to spearhead our data engineering efforts. The successful candidate will have a proven track record of leading cross-functional teams and working on large-scale distributed systems.
Key Responsibilities:
- Leading cross-functional teams to design and implement large-scale distributed systems.
- Collaborating with architects, product managers, and operations teams to ensure seamless integration of data engineering solutions.
- Developing and maintaining complex data processing pipelines using Apache Spark and other technologies.
- Designing and implementing scalable and secure data storage solutions using distributed blob storages.
- Ensuring data quality and integrity by developing and implementing data validation and cleaning processes.
The ideal candidate will possess the following skills and qualifications:
- Proven experience in managing cross-team collaboration with architects, product managers, and operations.
- Expertise in Scala and Python programming languages.
- Deep knowledge of Apache Spark internals and migration strategies.
- Experience with Apache Iceberg (or similar table formats like Delta Lake / Apache Hudi) for schema evolution, ACID transactions, and time travel.
- Running Spark and/or Flink jobs on Kubernetes (e.g., Spark-on-K8s operator, Flink-on-K8s).
- Experience with distributed blob storages like Ceph or AWS S3.
- Building ingestion, transformation, and enrichment pipelines for large-scale datasets.
- Infrastructure-as-Code (Terraform, Helm) for provisioning data infrastructure.
- Strong communication skills.
Benefits of this role include:
- Opportunity to work on large-scale distributed systems.
- Collaborative and dynamic team environment.
- Professional growth and development opportunities.
-
Big Data Innovator
1 hour ago
Shimoga, Karnataka, India beBeeData Full time US$ 1,20,000 - US$ 1,60,000Your potential unleashed.We present an opportunity to unleash and realise your potential amongst cutting-edge leaders, and organisations shaping the future of the region, and indeed, the world beyond. As a data engineer, you will work with a talented team to drive innovation and solve complex business problems using big data...
-
Chief Architect: Big Data Solutions
4 days ago
Shimoga, Karnataka, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Big Data LeaderLead a team of data engineers, working closely with clients and team members to understand their requirements and develop architectures that meet their needs.Key responsibilities include:Building pipelines to bring in various data from multiple sources within the organization and external sources.Collaborating with cross-functional teams to...
-
Cloud Architect
2 hours ago
Shimoga, Karnataka, India beBeeBigData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Job OverviewWe are seeking a highly skilled Cloud Architect to lead the design and implementation of our Big Data architecture.This is an exceptional opportunity to work with a talented team and contribute to the development of innovative data management solutions.Key Responsibilities:Design and implement scalable cloud-based architectures for Big Data...
-
Big Data Engineering Solution Specialist
5 days ago
Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Solution Architect for Big Data EngineeringWe are seeking an experienced Solution Architect to lead the design and implementation of large-scale data engineering solutions. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Data Factory, Synapse, Fabric, and Databricks. Additionally, they should have...
-
Data Engineering Leader
2 days ago
Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Senior Data EngineerThe role of a Senior Data Engineer involves designing, developing and maintaining data pipelines and data warehouse solutions. This position plays a critical role in ensuring the seamless flow of data across systems.This enables data-driven decision-making for our organization and clients.Key Responsibilities:Design scalable...
-
Big Data Expert
4 days ago
Shimoga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000**Unlocking Big Data Opportunities:**We are seeking a highly skilled data expert to design and develop innovative solutions that drive business growth.Essential Skills:PySparkHiveDesirable Skills:SparkHBaseData Quality ToolsAgile Methodologies ExperienceExposure in Data Ingestion from Various Sources onto Big Data PlatformsRequirements:A minimum of 6-12...
-
Big Data Specialist
8 hours ago
Shimoga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Big Data SpecialistDuration: Full-time OpportunityLocation: Shivamogga, India (Work from office)Key Responsibilities:Design and develop large-scale data processing architectures using SQL, Python, PySpark, and Linux.Implement complex data pipelines and distributed systems to handle high-velocity data streams effectively.Collaborate with...
-
Big Data Expert
2 hours ago
Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000We are currently hiring a Data Specialist to join our team. This role is ideal for professionals with 6-12 years of experience in Big Data technologies.This position requires extensive knowledge of data structures and algorithms.Key Skills We're Looking For:Mastery of Big Data tools including PySpark, Scala Spark, and Java Spark SQL.Experience in building...
-
Enterprise Data Engineering Leader
4 days ago
Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Enterprise Data Engineering LeaderLeads a team of data engineers in the design, development, and implementation of large-scale data engineering projects.Key Responsibilities:Designs and develops enterprise-level data engineering solutions using cloud-based platforms, ETL/ELT processes, and data warehousing techniques.Develops complex SQL queries,...
-
Big Data Solutions Architect
1 hour ago
Shimoga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Databricks EngineerWe are seeking an experienced professional to design, develop and maintain scalable, high-performance data solutions using Databricks.The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture. They will work with cross-functional teams to create robust...