Big Data Engineer

2 weeks ago


Noida, Uttar Pradesh, India DCS IT Solution Pvt. Ltd Full time ₹ 19,92,000 - ₹ 22,80,000 per year

Job Title: Python Databricks Engineer

Experience: 7–10 Years

Location: Noida

Job Summary

We are seeking a highly skilled Python Databricks Engineer with strong expertise in data engineering and cloud technologies. The ideal candidate will have a solid background in building scalable data pipelines, working with Databricks/Spark, and leveraging AWS services for data processing. Experience in healthcare data systems is a plus.

Key Responsibilities-

Design, develop, and optimize scalable data pipelines and workflows using Databricks, Spark, and Python.

Work with AWS services (S3, Lambda) to integrate and process large-scale datasets.

Develop, schedule, and monitor ETL/ELT processes using Airflow and other orchestration tools.

Collaborate with cross-functional teams to ensure data quality, security, and governance.

Requirements-

7–10 years of overall IT experience with at least 5+ years in Data Engineering.

2+ years of hands-on Python development.

Strong experience with Databricks and Spark.

Proficiency in SQL for querying and transforming data.

Hands-on experience with AWS technologies (S3, Lambda).

Experience with DataStage or similar ETL tools.

Strong knowledge of Airflow for workflow orchestration.

Exposure to healthcare data processing systems is highly desirable.

Ability to work in hybrid teams, mentor juniors, and provide technical guidance.

Technical Stack-

Databricks, Python, Spark, SQL

AWS (S3, Lambda)

Healthcare Data Processing Systems

Batch Processing Frameworks

Airflow, DataStage (or similar ETL tools)

Job Type: Full-time

Pay: ₹166, ₹190,000.00 per month

Work Location: In person


  • Big Data

    2 weeks ago


    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Why Join Us?Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industry?Do you want to do the best work of your life at one of thefastest growing IT services companies? Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations? It'shappening right hereat Iris Software.About Iris...

  • Big Data Engineer

    1 day ago


    Noida, Uttar Pradesh, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Spark Scala• Primary skills:Technology->Big Data - Data Processing->Spark • Good knowledge on software configuration management systems • Strong business acumen, strategy and cross-industry thought leadership • Awareness of latest technologies and Industry trends • Logical thinking and problem solving skills along with an ability to collaborate •...


  • Noida, Uttar Pradesh, India VARAISYS PVT. LTD. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Role:Big Data EngineerLocation:Noida (Work From Office)Experience:5 YearsRole OverviewWe're looking for aBig Data Engineerwho thrives on scale — the kind whereterabytes of data move every single day. You'll be building and optimizing high-throughput data pipelines that fuel analytics, AI, and business intelligence across the org.Key...


  • Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Why Join Us?Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industry?Do you want to do the best work of your life at one of thefastest growing IT services companies? Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations? It'shappening right hereat Iris Software.About Iris...


  • Noida, Uttar Pradesh, India Info Edge Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities: -Design, develop, and maintain robust data pipelines using Kafka, Airflow, and Spark. -Implement data models and schemas for efficient querying. -Develop and optimize code in Scala and Java for data processing tasks. -Monitor and troubleshoot data pipeline performance, ensuring data integrity and availability. -Collaborate with...


  • Noida, Uttar Pradesh, India Impetus Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    QualificationRequiredProven hands-on experience on designing, developing and supporting Database projects for analysis in a demanding environment.Proficient in database design techniques – relational and dimension designsExperience and a strong understanding of business analysis techniques used.High proficiency in the use of SQL or MDX queries.Ability to...

  • AWS Data Engineer

    2 weeks ago


    Noida, Uttar Pradesh, India Iris Software Full time ₹ 8,33,333 - ₹ 25,00,000 per year

    AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferredSkills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shiftGood communication skills and can deliver independently*Mandatory Competencies*Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS...


  • Noida, Uttar Pradesh, India Paytm Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Principal Engineer- Data DevopsJob Overview: We are seeking an experienced Principal Engineer (Data DevOps) to lead our Data DevOps team in building, managing, and optimizing high-scale, secure, and reliable big data platforms. The ideal candidate will combine strong technical expertise with proven leadership skills, driving best practices in cloud...

  • Data Engineer

    1 day ago


    Noida, Uttar Pradesh, India Cloudkeeper Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position Overview:We are looking for an experienced and driven Data Engineer to join our team. The ideal candidate will have a strong foundation in big data technologies, particularly Spark, and a basic understanding of Scala to design and implement efficient data pipelines. As a Data Engineer at CloudKeeper, you will be responsible for building and...

  • QA Engineer

    2 weeks ago


    Noida, Uttar Pradesh, India Big Oh Tech Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a highly skilled and motivated QA Engineer (Manual Testing) with expertise in Python and. NET to join our dynamic team. You will play a critical role in ensuring the quality and reliability of our products through thorough manual testing. Your proficiency in Python and. NET will be essential in creating comprehensive testing frameworks and...