Big Data Engineer

2 weeks ago


Noida, Uttar Pradesh, India DCS IT Solution Pvt. Ltd Full time ₹ 1,66,000 - ₹ 19,00,000 per year

Job Title: Python Databricks Engineer

Experience: 7–10 Years

Location: Noida

Job Summary

We are seeking a highly skilled Python Databricks Engineer with strong expertise in data engineering and cloud technologies. The ideal candidate will have a solid background in building scalable data pipelines, working with Databricks/Spark, and leveraging AWS services for data processing. Experience in healthcare data systems is a plus.

Key Responsibilities-

Design, develop, and optimize scalable data pipelines and workflows using Databricks, Spark, and Python.

Work with AWS services (S3, Lambda) to integrate and process large-scale datasets.

Develop, schedule, and monitor ETL/ELT processes using Airflow and other orchestration tools.

Collaborate with cross-functional teams to ensure data quality, security, and governance.

Requirements-

7–10 years of overall IT experience with at least 5+ years in Data Engineering.

2+ years of hands-on Python development.

Strong experience with Databricks and Spark.

Proficiency in SQL for querying and transforming data.

Hands-on experience with AWS technologies (S3, Lambda).

Experience with DataStage or similar ETL tools.

Strong knowledge of Airflow for workflow orchestration.

Exposure to healthcare data processing systems is highly desirable.

Ability to work in hybrid teams, mentor juniors, and provide technical guidance.

Technical Stack-

Databricks, Python, Spark, SQL

AWS (S3, Lambda)

Healthcare Data Processing Systems

Batch Processing Frameworks

Airflow, DataStage (or similar ETL tools)

Job Type: Full-time

Pay: ₹166, ₹190,000.00 per month

Work Location: In person


  • Big Data Engineer

    2 weeks ago


    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 25,00,000

    Big Data EngineeringAt the forefront of big data processing lies a complex web of systems, tools and workflows. To engineer such processes requires expertise in multiple areas, including data flow platforms, workflow management and large dataset integration.Our ideal candidate will possess hands-on experience with Apache Spark, utilizing Scala for...

  • Big Data

    2 weeks ago


    Noida, Uttar Pradesh, India Iris Software Inc. Full time

    Job DescriptionWhy Join UsAre you inspired to grow your career at one of Indias Top 25 Best Workplaces in IT industry Do you want to do the best work of your life at one of the fastest growing IT services companies Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations Its happening right here at Iris...

  • Big Data

    2 weeks ago


    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Why Join Us?Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industry?Do you want to do the best work of your life at one of thefastest growing IT services companies? Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations? It'shappening right hereat Iris Software.About Iris...


  • Noida, Uttar Pradesh, India IRIS software Full time

    Job DescriptionWhy Join UsAre you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industryDo you want to do the best work of your life at one of thefastest growing IT services companies Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations It'shappening right hereat Iris...


  • Noida, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking a highly skilled Big Data Engineer to design, architect, and implement scalable data engineering solutions using AWS services. The ideal candidate will bring strong hands-on experience in designing and optimizing Big Data architectures.Key ResponsibilitiesDesign and develop Big Data architectures leveraging AWS services for...


  • Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Why Join Us?Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industry?Do you want to do the best work of your life at one of thefastest growing IT services companies? Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations? It'shappening right hereat Iris Software.About Iris...

  • Big Data Expert

    1 week ago


    Noida, Uttar Pradesh, India beBeeCloudDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer Job OpportunityWe are seeking a skilled Cloud Data Engineer to work with our team on a challenging project involving big data processing and analytics using the Databricks platform.The ideal candidate will have strong expertise in Databricks, proficiency in Python programming, and experience with data manipulation libraries such as Pandas...

  • Data Scientist

    2 weeks ago


    Noida, Uttar Pradesh, India BIG Language Solutions Full time

    Job Description – Data Scientist- Design, build, and maintain robust and scalable applications using Python and advanced AI frameworks.- Develop complex, multi-step workflows and autonomous systems using LLM Orchestrators like LangChain, LlamaIndex, or Semantic Kernel.- Integrate AI models and agentic systems with our existing data pipelines, APIs, and...

  • Senior Data Engineer

    2 weeks ago


    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Looking for a challenging role in data engineering? This position is perfect for you!About the JobWe are seeking an experienced Data Engineer to join our team and contribute to building scalable, reliable, and secure data pipelines using PySpark and Azure cloud platform.The ideal candidate will have strong programming skills in Python and Scala, with...


  • Noida, Uttar Pradesh, India Impetus Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    QualificationRequiredProven hands-on experience on designing, developing and supporting Database projects for analysis in a demanding environment.Proficient in database design techniques – relational and dimension designsExperience and a strong understanding of business analysis techniques used.High proficiency in the use of SQL or MDX queries.Ability to...