Senior Data Engineer
6 days ago
Job Summary :
We are seeking an experienced Senior Data Engineer with strong expertise in Databricks, Apache Airflow, SQL, and Python to design and optimize data pipelines, ETL workflows, and cloud-based data solutions. The ideal candidate will have deep experience in big data processing, cloud-based analytics, and automation to drive efficient and scalable data engineering solutions.
Key Responsibilities :
- Design, develop, and optimize data pipelines using Databricks and Apache Airflow.
- Implement PySpark-based transformations and processing in Databricks for handling large-scale data.
- Develop and maintain SQL-based data pipelines, ensuring performance tuning and optimization.
- Create Python scripts for automation, data transformation, and API-based data ingestion.
- Work with Airflow DAGs to schedule and orchestrate data workflows efficiently.
- Optimize data lake and data warehouse performance for scalability and reliability.
- Integrate data pipelines with cloud platforms (AWS, Azure, or GCP) and various data storage solutions.
- Ensure adherence to data security, governance, and compliance standards.
Required Skills & Qualifications :
years of experience in Data Engineering or related fields.
- Strong expertise in Databricks (PySpark, Delta Lake, DBSQL).
- Proficiency in Apache Airflow for scheduling and orchestrating workflows.
- Advanced SQL skills for data extraction, transformation, and performance tuning.
- Strong programming skills in Python (pandas, NumPy, PySpark, APIs).
- Experience with big data technologies and distributed computing.
- Hands-on experience with cloud platforms (AWS / Azure / GCP).
- Expertise in data warehousing and data modeling concepts.
- Understanding of CI/CD pipelines, version control (Git)
- Experience with data governance, security, and compliance best practices.
- Excellent troubleshooting, debugging, and performance optimization skills.
-
Senior Data Engineer cum Data Scientist
6 days ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...
-
Senior Azure Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per yearERP Senior Specialist Job Title: Azure Senior Data Engineer We are looking a highly skilled and experienced Senior Azure Data Engineer to join our team. This role requires deep expertise in Azure Data Factory and Databricks, including CI/CD setup for Databricks, and strong proficiency in ETL, SQL, and modern data engineering practices. You will be the...
-
Data Engineer Senior Consultant
4 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,20,000 - ₹ 3,00,000 per yearReq ID: 341131NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Location: | Experience:...
-
Senior Data Scientist
1 week ago
Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...
-
Senior Data Scientist
6 days ago
Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...
-
Data Engineer
6 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDesign and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...
-
Senior Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Capco Technologies Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per yearData Engineer -SCALA Job Title: Senior Data Engineer/Developer Number of Positions: 2 Job Description: The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and complexity. They will collaborate with analytics...
-
Senior Data Engineer
8 hours ago
Bengaluru, Karnataka, India Tap Growth ai Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe're Hiring: Senior Data Engineer We are seeking an experienced Senior Data Engineer to design, build, and maintain robust data infrastructure and pipelines. The ideal candidate will have expertise in big data technologies, cloud platforms, and data architecture to support our analytics and business intelligence initiatives. Location:Bengaluru, India Work...
-
Senior Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Capco Technologies Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSRE Specialist - Bangalore Job Title: Senior Data Engineer/Developer Number of Positions: 2 Job Description: The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and complexity. They will collaborate with...
-
Senior Software Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per yearReq ID: 343115NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Software Engineer - Generative AI and Intelligent Automation to join our team in Bangalore, Karnātaka (IN-KA),...