Data Engineer

2 days ago

Gurgaon, Haryana, India Bain Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Position Summary:

We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have strong expertise in Python, SQL, and PySpark, with proven experience working on Databricks and cloud platforms such as Azure, AWS, or GCP.

A solid understanding of ETL tools like Python as well as basic knowledge of DevOps practices and CI/CD pipelines, will be advantageous.

This is a unique opportunity to work in a dynamic and fast-paced environment to design and implement robust data solutions for scalable business needs. Working with Git and versioning.

Key Responsibilities:

  • Data Pipeline Development:
  • Design, build, and optimize ETL/ELT workflows using tools like Databricks, SQL, Python/pyspark & Alteryx (Good to have).

  • Develop and maintain robust, scalable, and efficient data pipelines for processing large datasets. from source to emerging data.

  • Cloud Data Engineering:

  • Work on cloud platforms (Azure, AWS) to build and manage data lakes, data warehouses, and scalable data architectures.

  • Utilize cloud services like Azure Data Factory, AWS Glue, or for data processing and orchestration.

  • Databricks and Big Data Solutions:

  • Use Databricks for big data processing, analytics, and real-time data processing.

  • Leverage Apache Spark for distributed computing and handling complex data transformations.

  • Data Management:

  • Create and manage SQL-based data solutions, ensuring high availability, scalability, and performance.

  • Develop and enforce data quality checks and validation mechanisms.

  • Collaboration and Stakeholder Engagement:

  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to deliver impactful data solutions.

  • Understand business requirements and translate them into technical solutions.

  • DevOps and CI/CD:

  • Leverage CI/CD pipelines to streamline development, testing, and deployment of data engineering workflows.

  • Work with DevOps tools like Git, Jenkins, or Azure DevOps for version control and automation.

  • Documentation and Optimization:

  • Maintain clear documentation for data workflows, pipelines, and processes.
  • Optimize data systems for performance, scalability, and cost-efficiency

Required Qualifications, Experience and Skills

Educational Qualifications:

  • Bachelors or Masters degree in Computer Science, Information Technology, Engineering, or a related field.

Experience:

  • 3 to 6 years of experience in Data Engineering or related roles.
  • Hands-on experience with big data processing frameworks, data lakes, and cloud-native services.

Skills:

  • Core Skills:
  • Proficiency in Python, SQL, and PySpark for data processing and manipulation.
  • Proven experience in Databricks and Apache Spark.
  • Expertise in working with cloud platforms like Azure, AWS.

  • Sound knowledge of ETL processes and tools like Alteryx. (Good to have)

  • Data Engineering Expertise:

  • Leveraging data lakes, data warehouses, and data pipelines.
  • Data Pipeline Build a Data Pipeline from scratch

  • Strong understanding of distributed systems and big data technologies.

  • DevOps and CI/CD:

  • Basic understanding of DevOps principles and familiarity with CI/CD pipelines.

  • Hands-on experience with tools like Git, Jenkins, or Azure DevOps.

  • Additional Skills:

  • Familiarity with data visualization tools like Power BI, Tableau, or similar is a plus.
  • Knowledge of streaming technologies such as Kafka or Event Hubs is desirable.
  • Strong problem-solving skills and a knack for optimizing data solutions.
  • Excellent communication (oral and written) skills

  • Principal Software/Data Engineering

    2 days ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    About CoPoint DataCoPoint Data is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients....

  • Senior Web Developer and Data Engineer

    2 days ago

    Gurgaon, Haryana, India CoPoint Data Full time US$ 1,20,000 - US$ 2,00,000 per year

    About CoPoint AICoPoint AI is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients. Our...

  • Data Engineer

    2 days ago

    Gurgaon, Haryana, India Obrimo Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Responsibilities:Develop, implement, and maintain efficient and scalable data engineeringsolutions to support the company's data initiatives.Collaborate with cross-functional teams to understand businessrequirements and translate them into technical data engineeringsolutions.Build and maintain data pipelines to ingest, transform, and store datafrom...

  • Data engineer

    2 days ago

    Gurgaon, Haryana, India Orbion Infotech Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionOrbion Infotech is your trusted partner for comprehensive software services and top-tier staff augmentation solutions. With a track record of success, we empower organizations to thrive in today's digital landscape. Our dedicated team of industry experts offers custom software development, staff augmentation, and strategic technology...

  • Data Engineer

    2 days ago

    Gurgaon, Haryana, India Healthpoint Ventures Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionAt Healthpoint Ventures, we are dedicated to fostering innovation in healthcare through strategic collaboration with providers, payers, and stakeholders. Our mission is to harness the power of artificial intelligence to maximize value across the healthcare ecosystem. By driving impactful projects and joint ventures, we leverage AI to...

  • Data Engineer

    2 days ago

    Gurgaon, Haryana, India Digital Business People Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title:Data EngineerLocation:Gurgaon (On-site)Experience:4 YearsJoining:ImmediateAbout the RoleWe are looking for a skilledData Engineerwith strong expertise inPython, AWS Cloud, and Redshiftto design, build, and maintain scalable data pipelines and solutions. The ideal candidate will have hands-on experience with large-scale data systems, cloud...

  • Data Engineer

    2 days ago

    Gurgaon, Haryana, India ExcelGens, Inc. Full time US$ 90,000 - US$ 1,20,000 per year

    We're Hiring: Data Engineer (Microsoft Fabric Specialist) Are you an experienced Data Engineer (5–7 years) with strong hands-on expertise in Microsoft Fabric?Join ExcelGens in Gurgaon and play a key role in building scalable, modern, and intelligent data solutions.What you'll do: Design & develop data pipelines using Microsoft Fabric (Data Factory, Data...

  • Data Engineer

    2 days ago

    Gurgaon, Haryana, India Milliman Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    What Is Expected Of You At This LevelWe are seeking an experienced Azure Data Engineer with 4+ years in data engineering to join our team. In this role, you will design, build, and optimize high-performance data pipelines on Azure, delivering scalable, efficient, and reliable data solutions. You will take ownership of developing and maintaining critical data...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Staffice Global Private Limited Full time

    Job DescriptionThis role is for a Data Engineer with extensive experience in data engineering, data warehousing, and big data processing. The ideal candidate will have strong expertise in Python, PySpark, and AWS data services to design, develop, and maintain robust data pipelines.Key Responsibilities- Design and implement end-to-end data engineering...

  • Data Engineer

    7 days ago

    Gurgaon, Haryana, India RBS Full time US$ 9,00,000 - US$ 12,00,000 per year

    Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and...