
Big Data Engineering Lead
1 day ago
Job Opportunity:
We are seeking a highly skilled data engineer to lead our distributed teams in managing large-scale datasets.
The ideal candidate will have 7-12 years of experience in managing cross-functional collaboration with architects, product managers, and operations teams.
Key Requirements Include:
- Proven expertise in Scala and Python programming languages.
- Deep understanding of HDFS internals and migration strategies.
- Experience with Apache Iceberg (or similar table formats like Delta Lake / Apache Hudi) for schema evolution, ACID transactions, and time travel.
- Ability to run Spark and/or Flink jobs on Kubernetes (e.g., Spark-on-K8s operator, Flink-on-K8s).
- Experience with distributed blob storages like Ceph or AWS S3.
- Proficiency in building ingestion, transformation, and enrichment pipelines for large-scale datasets.
- Infrastructure-as-Code (Terraform, Helm) for provisioning data infrastructure.
- Strong communication and project management skills.
About the Role:
This position offers a unique opportunity to work with cutting-edge technology and collaborate with a talented team of professionals.
Our Organization:
We enable positive business outcomes for enterprise companies undergoing digital transformation by solving their most pressing technical challenges.
-
Big Data Engineer Manager
6 days ago
Tirupati, Andhra Pradesh, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Big Data Engineer Manager - Cloud ArchitectureOverviewWe are seeking a highly experienced and strategic engineering manager to lead our team of data engineers. The ideal candidate will have deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The successful candidate will design and deliver scalable data pipelines and analytics...
-
Senior Big Data Architect
7 days ago
Tirupati, Andhra Pradesh, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Senior Big Data ArchitectJob Summary:About this Role:We are seeking an experienced and strategic technology leader with expertise in designing and delivering scalable data solutions using Microsoft Azure, Databricks, and Big Data platforms.The ideal candidate will lead a team of talented engineers to architect and oversee the development of...
-
Engineering Manager – Big Data, Azure
6 days ago
Tirupati, Andhra Pradesh, India DataE2E Technologies Full timeTechnical Manager – AzureLocation: 100% RemoteEmployment Type: Full-timeShift Timing : 3 pm – 11 pm ISTJob Summary:About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The ideal candidate will lead a team of talented data engineers to design and...
-
Highly Experienced Data Engineer Lead
1 day ago
Tirupati, Andhra Pradesh, India beBeeData Full time US$ 1,20,000 - US$ 1,40,000Job DescriptionAs a seasoned data engineer, you will lead the development and enhancement of large-scale data modules across various systems. Your expertise in SQL, databases, and big data tools will be invaluable to our team.The successful candidate will design, optimize, and maintain scalable data pipelines using a combination of SQL, NoSQL, and Big Data...
-
Big Data Leader
2 weeks ago
Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Summary:A Big Data Leader is required to head a team of data engineers. This person will work closely with clients and team members to understand their requirements and develop architectures that meet their needs.Key ResponsibilitiesIn this role, you will support the Data Engineering team in setting up the Data Lake on Cloud and the implementation of...
-
Big Data Solutions Specialist
5 days ago
Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 2,00,00,000Big Data ExpertWelcome to a role where you will be responsible for developing and implementing Big Data solutions using PySpark and Hive.This position is ideal for experts in data analytics who are passionate about working with large datasets and extracting valuable insights from them.Develop and implement Big Data solutions using PySpark and Hive.Work on...
-
Big Data Hadoop Developer
1 day ago
Tirupati, Andhra Pradesh, India beBeeHadoop Full time ₹ 12,88,000 - ₹ 24,96,000Big Data Hadoop DeveloperWe are seeking a skilled Big Data Hadoop Developer to join our team. As a key member of our technology team, you will be responsible for designing, developing and implementing large-scale data processing systems using Big Data Hadoop ecosystem.Key Responsibilities:Design and develop scalable data pipelines using Hadoop, Spark, and...
-
Big Data Database Administration Role
5 days ago
Tirupati, Andhra Pradesh, India beBeeDatabaseAdministrator Full time ₹ 15,00,000 - ₹ 20,00,000Database Administrator PositionThis is a senior-level role that requires in-depth knowledge of database systems and technologies. We are seeking an experienced professional to join our Big Data team, where they will be responsible for analyzing existing databases, recommending improvements, and ensuring high availability and performance.The ideal candidate...
-
Data engineer
2 weeks ago
Tirupati, Andhra Pradesh, India Firstsource Full timeKey Skills and Responsibilities:We are seeking a Senior Data Engineer with a strong background in cloud-native data engineering, primarily on Microsoft Azure, and familiarity with AWS and GCP. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...
-
Senior Big Data ETL Tester
5 days ago
Tirupati, Andhra Pradesh, India beBeeDataValidator Full time ₹ 10,00,000 - ₹ 20,00,000Big Data ETL ValidatorThe role of Big Data ETL Validator involves ensuring the accuracy and integrity of data across various layers in a Databricks environment.Main Responsibilities:Create comprehensive test plans to validate data transformations, ingestion, and processing logic.Develop complex SQL queries to verify data consistency and adherence to business...