Data Engineer

3 days ago

Gurgaon, Haryana, India Bain Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Position Summary:

We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have strong expertise in Python, SQL, and PySpark, with proven experience working on Databricks and cloud platforms such as Azure, AWS, or GCP.

A solid understanding of ETL tools like Python as well as basic knowledge of DevOps practices and CI/CD pipelines, will be advantageous.

This is a unique opportunity to work in a dynamic and fast-paced environment to design and implement robust data solutions for scalable business needs. Working with Git and versioning.

Key Responsibilities:

  • Data Pipeline Development:
  • Design, build, and optimize ETL/ELT workflows using tools like Databricks, SQL, Python/pyspark & Alteryx (Good to have).

  • Develop and maintain robust, scalable, and efficient data pipelines for processing large datasets. from source to emerging data.

  • Cloud Data Engineering:

  • Work on cloud platforms (Azure, AWS) to build and manage data lakes, data warehouses, and scalable data architectures.

  • Utilize cloud services like Azure Data Factory, AWS Glue, or for data processing and orchestration.

  • Databricks and Big Data Solutions:

  • Use Databricks for big data processing, analytics, and real-time data processing.

  • Leverage Apache Spark for distributed computing and handling complex data transformations.

  • Data Management:

  • Create and manage SQL-based data solutions, ensuring high availability, scalability, and performance.

  • Develop and enforce data quality checks and validation mechanisms.

  • Collaboration and Stakeholder Engagement:

  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to deliver impactful data solutions.

  • Understand business requirements and translate them into technical solutions.

  • DevOps and CI/CD:

  • Leverage CI/CD pipelines to streamline development, testing, and deployment of data engineering workflows.

  • Work with DevOps tools like Git, Jenkins, or Azure DevOps for version control and automation.

  • Documentation and Optimization:

  • Maintain clear documentation for data workflows, pipelines, and processes.
  • Optimize data systems for performance, scalability, and cost-efficiency

Required Qualifications, Experience and Skills

Educational Qualifications:

  • Bachelors or Masters degree in Computer Science, Information Technology, Engineering, or a related field.

Experience:

  • 3 to 6 years of experience in Data Engineering or related roles.
  • Hands-on experience with big data processing frameworks, data lakes, and cloud-native services.

Skills:

  • Core Skills:
  • Proficiency in Python, SQL, and PySpark for data processing and manipulation.
  • Proven experience in Databricks and Apache Spark.
  • Expertise in working with cloud platforms like Azure, AWS.

  • Sound knowledge of ETL processes and tools like Alteryx. (Good to have)

  • Data Engineering Expertise:

  • Leveraging data lakes, data warehouses, and data pipelines.
  • Data Pipeline Build a Data Pipeline from scratch

  • Strong understanding of distributed systems and big data technologies.

  • DevOps and CI/CD:

  • Basic understanding of DevOps principles and familiarity with CI/CD pipelines.

  • Hands-on experience with tools like Git, Jenkins, or Azure DevOps.

  • Additional Skills:

  • Familiarity with data visualization tools like Power BI, Tableau, or similar is a plus.
  • Knowledge of streaming technologies such as Kafka or Event Hubs is desirable.
  • Strong problem-solving skills and a knack for optimizing data solutions.
  • Excellent communication (oral and written) skills

  • Data Engineer Advisor

    1 week ago

    Gurgaon, Haryana, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: 338198NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN). Technical Support: Provide L1, L2...

  • Principal Software/Data Engineering

    1 day ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About CoPoint DataCoPoint Data is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients....

  • Senior Web Developer and Data Engineer

    1 day ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About CoPoint AICoPoint AI is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients. Our...

  • Data Scientist

    1 day ago

    Gurgaon, Haryana, India Data Sutram Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    *Data Sutram,*funded by India Infoline (IIFL), Indian Angel Network (IAN) and 100x.VC (led by Sanjay Mehta), is an alternate data company, using external data feeds to create every location's DNA that is utilized in various use cases like credit underwriting, location profiling, site selection, etc. It is one of the fastest-growing companies in the space of...

  • Digital Engineering Engineer

    2 weeks ago

    Gurgaon, Haryana, India NTT DATA Full time

    Req ID 295081NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Engineer to join our team in Gurgaon Hary xc4 x81na IN-HR India IN Job Duties Must have ...

  • Data Engineer Advisor

    1 week ago

    Gurgaon, Haryana, India NTT DATA North America Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Req ID:338198NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN).Technical Support:Provide L1, L2 and L3...

  • Software Engineer

    4 days ago

    Gurgaon, Haryana, India Auto Data Catalog Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Company DescriptionAuto Data Catalog (ADC) is revolutionizing how businesses interact with their data by building an AI-powered platform that eliminates barriers between business users and their data insights. Our AI agents offer instant, actionable insights through simple questions in plain English, transforming data analytics from a technical bottleneck...

  • Data Engineer

    3 days ago

    Gurgaon, Haryana, India Obrimo Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Responsibilities:Develop, implement, and maintain efficient and scalable data engineeringsolutions to support the company's data initiatives.Collaborate with cross-functional teams to understand businessrequirements and translate them into technical data engineeringsolutions.Build and maintain data pipelines to ingest, transform, and store datafrom...

  • Data engineer

    3 days ago

    Gurgaon, Haryana, India Orbion Infotech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionOrbion Infotech is your trusted partner for comprehensive software services and top-tier staff augmentation solutions. With a track record of success, we empower organizations to thrive in today's digital landscape. Our dedicated team of industry experts offers custom software development, staff augmentation, and strategic technology...

  • Data Engineer

    1 day ago

    Gurgaon, Haryana, India Healthpoint Ventures Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionAt Healthpoint Ventures, we are dedicated to fostering innovation in healthcare through strategic collaboration with providers, payers, and stakeholders. Our mission is to harness the power of artificial intelligence to maximize value across the healthcare ecosystem. By driving impactful projects and joint ventures, we leverage AI to...