Senior Data Engineer

1 day ago


Bengaluru Hyderabad Pune, India KPI Partners Full time US$ 1,00,000 - US$ 1,50,000 per year

Job Description:

KPI Partners is seeking a Senior Data Engineer with expertise in Databricks to join our dynamic team. The ideal candidate will have substantial experience in data engineering and a strong background in leveraging Databricks for big data processing and analytics.

Key Responsibilities:

- Design, develop, and maintain scalable data pipelines and data models using Databricks and associated technologies.

- Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet business objectives.

- Optimize data processing workflows for efficiency and performance.

- Implement data quality checks and ensure the reliability and accuracy of data across various platforms.

- Work with cloud storage solutions and manage data ingestion from various sources.

- Participate in architectural discussions and contribute to the technical roadmap for data solutions.

- Monitor and troubleshoot data pipelines to ensure optimal operation and resolution of issues.

- Document data engineering processes and provide training to junior engineers as needed.

Qualifications:

- Bachelor's degree in Computer Science, Engineering, or related field; Master's degree preferred.

- 5+ years of experience in data engineering, with at least 2 years of experience working with Databricks.

- Proficiency in programming languages such as Python, Scala, or Java.

- Strong understanding of data warehousing concepts and ETL processes.

- Experience with big data technologies such as Spark, Hadoop, or Kafka is essential.

- Knowledge of cloud platforms like AWS, Azure, or GCP and their respective data services.

- Excellent problem-solving skills and the ability to work in a fast-paced environment.

- Strong communication skills and teamwork abilities.

What We Offer:

- Competitive salary and benefits package.

- Opportunity to work on challenging projects with cutting-edge technologies.

- Collaborative and innovative work environment.

- Opportunities for professional growth and advancement within the company.

If you are passionate about data engineering and looking to make a significant impact at KPI Partners, we encourage you to apply for the Senior Data Engineer - Databricks position.



  • Hyderabad, India Data Economy Full time

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...


  • Hyderabad, Telangana, India Data Economy Full time ₹ 20,00,000 - ₹ 35,00,000 per year

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...


  • Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...


  • Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, India Enable Data Incorporated Full time

    Experience Required: 8+Years Mode of work: Remote Skills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025) Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...


  • Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...


  • Hyderabad, Telangana, India NTT Data Full time

    Job DescriptionReq ID:330296NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer Senior Consultant to join our team in Hyderabad, Telangana (IN-TG), India (IN).- Understand...


  • Hyderabad, India ICE Data Services Full time

    Job Purpose The Property Data Engineeris responsible for developing and maintaining data conversion programs that transform raw property assessment data into standardized formats based on specifications by Property Data Analyst and Senior Analysts. This role requires not only advanced programming and ETL skills but also a deep understanding of the structure,...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)- Translate business rules into technical specifications and implement scalable data solutions.- Manage...

  • Data Engineer

    2 weeks ago


    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...