Data Engineer

4 weeks ago

Gurugram, India Weekday AI Full time

This role is for one of Weekday’s clients Min Experience: 5 years Location: Gurgaon, Gurugram JobType: full-time Requirements We are seeking an experienced Data Engineer with strong expertise in AWS, Databricks, PySpark, and SQL to design, develop, and optimize scalable data pipelines. The ideal candidate will have a deep understanding of modern data architectures, ETL frameworks, and cloud-based data ecosystems. You will work closely with data scientists, analysts, and business stakeholders to ensure reliable, high-quality, and timely data delivery that powers key business decisions and analytics initiatives. This role requires both hands-on technical capability and strategic thinking, as you’ll contribute to building robust data foundations and scalable data platforms. Key Responsibilities - Data Pipeline Development: - Design, build, and maintain scalable ETL/ELT pipelines for both batch and streaming data processing using PySpark and Databricks. - Optimize and automate data workflows to ensure efficient and reliable data movement across systems. - Develop end-to-end data integration solutions from diverse data sources to centralized data lakes and warehouses. - Cloud Data Engineering (AWS): - Work extensively with AWS data services such as S3, Glue, Kinesis, and Redshift to design and manage modern data architectures. - Implement data lake and data warehouse solutions ensuring scalability, security, and performance. - Build workflow orchestration using Airflow, AWS Step Functions, or similar tools for automation and scheduling. - Data Modeling & Optimization: - Develop and optimize SQL queries for performance, scalability, and data quality. - Design data models and schemas to support analytical workloads and reporting. - Ensure data accuracy, consistency, and lineage through validation and quality checks. - Collaboration & Cross-Functional Support: - Work closely with data scientists, analysts, and product teams to understand data requirements and deliver relevant datasets for analytics and machine learning use cases. - Partner with platform and DevOps teams to ensure smooth data pipeline deployment and monitoring. - Translate complex technical concepts into business-friendly insights and documentation. - Data Governance & Security: - Implement data management best practices, including metadata management, access controls, and compliance with data governance standards. - Ensure adherence to security and privacy guidelines across all data solutions. Key Skills and Qualifications - 5+ years of professional experience as a Data Engineer or similar role in a cloud-based environment. - Expertise in PySpark for distributed data processing and transformation. - Advanced proficiency in SQL—query optimization, performance tuning, and large-scale data manipulation. - Hands-on experience with Databricks for collaborative data development and pipeline orchestration. - Strong understanding of AWS Data Stack, including S3, Glue, Kinesis, Lambda, and Redshift. - Experience in building and maintaining data lakes and data pipelines (batch and streaming). - Proficiency in workflow orchestration tools such as Airflow or AWS Step Functions. - Familiarity with data versioning, CI/CD pipelines, and infrastructure-as-code (IaC) is a plus. - Strong problem-solving skills, attention to detail, and ability to work in fast-paced, agile environments.

  • Senior Tableau Data Consultant

    6 days ago

    Gurugram, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions. The candidate is expected to lead the following work-streams: Partner...

  • Senior Tableau Data Consultant

    4 days ago

    Gurugram, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions. The candidate is expected to lead the following work-streams:  Partner...

  • Senior Tableau Data Consultant

    4 days ago

    Gurugram, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions. The candidate is expected to lead the following work-streams:  Partner...

  • Software Engineer

    3 weeks ago

    Gurugram, Gurugram, India Auto Data Catalog Full time

    Job Description Company Description Auto Data Catalog (ADC) is revolutionizing how businesses interact with their data by building an AI-powered platform that eliminates barriers between business users and their data insights. Our AI agents offer instant, actionable insights through simple questions in plain English, transforming data analytics from a...

  • Data Engineer

    4 weeks ago

    Gurugram, India Llp S3bglobal Technologies Full time

    Job Description We are seeking a skilled Data Engineer to join our team in India. The ideal candidate will have a passion for data and the ability to transform raw data into actionable insights. You will be responsible for designing and maintaining data pipelines and ensuring the integrity and accessibility of data across our organization. Responsibilities -...

  • Data Engineer

    2 weeks ago

    Gurugram, India Questhiring Full time

    About the job :Responsibilities :- Work closely with product managers to understand customer needs and translate those into technical requirements.- Build and maintain scalable data management and serving infrastructure on cloud, managing terabytes of data and integrating cost.- Design a comprehensive target data architecture vision working closely with...

  • Data Engineer

    2 weeks ago

    Gurugram, Gurugram, India CoPoint AI Full time

    Job Description Senior Data Engineer Location: India (Gurugram) About CoPointAI AI isn't coming it's here. And we help enterprises make it real. At CoPointAI, we work inside the enterprise not just around it to turn AI potential into practical wins. From hands-on C-suite workshops (our AI Foundations series) to AI-native MVPs built in weeks, our team...

  • Eucloid - Senior Tableau Data Consultant

    6 days ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    We are looking for a high-energy individual for the role of Data Consultant - Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions. The candidate is expected to lead the following work-streams:- Partner with...

  • Manager-Data Engineering-Cloud Data Engineering

    2 weeks ago

    Gurugram, Gurugram, India EXL Full time

    Job Description Job Summary Data Engineer Consultant Job Description Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.. Qualifications And Skills - Strong knowledge on Python and Pyspark - Expectation is to have ability to write Pyspark scripts...

  • Eucloid - Senior Data Consultant

    6 days ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    We are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team. The candidate is expected to lead following work-streams:- Collaborate with stakeholders to understand current data sources, reporting gaps, and business objectives....