Data Engineer

2 weeks ago

gurugram, India Material Full time

Role :- AWS Data EngineerLocation :- Gurgaon / BangaloreNotice :- Immediate Joiners Only Skills:- AWS , Spark , Python , Glue , S3 , Redshift etc.. Experience:- 4+ YearsPosition Overview: We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with AWS Glue, Apache Airflow, Kafka, SQL, Python and DataOps tools and technologies. Knowledge of SAP HANA & Snowflake is a plus. This role is critical for designing, developing, and maintaining our client’s data pipeline architecture, ensuring the efficient and reliable flow of data across the organization. Key Responsibilities: Design, Develop, and Maintain Data Pipelines:Develop robust and scalable data pipelines using AWS Glue, Apache Airflow, and other relevant technologies.Integrate various data sources, including SAP HANA, Kafka, and SQL databases, to ensure seamless data flow and processing.Optimize data pipelines for performance and reliability.Data Management and Transformation:Design and implement data transformation processes to clean, enrich, and structure data for analytical purposes.Utilize SQL and Python for data extraction, transformation, and loading (ETL) tasks.Ensure data quality and integrity through rigorous testing and validation processes.Collaboration and Communication:Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.Collaborate with cross-functional teams to implement DataOps practices and improve data life cycle management.Monitoring and Optimization:Monitor data pipeline performance and implement improvements to enhance efficiency and reduce latency.Troubleshoot and resolve data-related issues, ensuring minimal disruption to data workflows.Implement and manage monitoring and alerting systems to proactively identify and address potential issues.Documentation and Best Practices:Maintain comprehensive documentation of data pipelines, transformations, and processes.Adhere to best practices in data engineering, including code versioning, testing, and deployment procedures.Stay up-to-date with the latest industry trends and technologies in data engineering and DataOps.Required Skills and Qualifications: Technical Expertise:Extensive experience with AWS Glue for data integration and transformation.Proficient in Apache Airflow for workflow orchestration.Strong knowledge of Kafka for real-time data streaming and processing.Advanced SQL skills for querying and managing relational databases.Proficiency in Python for scripting and automation tasks.Experience with SAP HANA for data storage and management.Familiarity with Data Ops tools and methodologies for continuous integration and delivery in data engineering.Preferred Skills:Knowledge of Snowflake for cloud-based data warehousing solutions.Experience with other AWS data services such as Redshift, S3, and Athena.Familiarity with big data technologies such as Hadoop, Spark, and Hive.Soft Skills:Strong analytical and problem-solving skills.Excellent communication and collaboration abilities.Detail-oriented with a commitment to data quality and accuracy.Ability to work independently and manage multiple projects simultaneously.

  • Data Engineers/Modelers

    3 weeks ago

    Gurugram, India NTT DATA Services Full time

    Data Engineers/Modelers - 8+ years of experience mAnalyticsResponsibilitiesDevelop and implement data pipeline for ingestion , loading and transformation of data sets from other systemsDesign and develop logical and physical data models as per business requirements.Perform data analysis to identify relationships, patterns and trends in dataEnsure data...

  • Data Engineer

    2 weeks ago

    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Eucloid - Data Engineer - Azure Databricks

    5 months ago

    Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Senior Data Engineer

    6 days ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...

  • Data Engineer

    2 weeks ago

    gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    3 weeks ago

    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong big query...

  • Data Engineer

    3 weeks ago

    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    3 weeks ago

    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    3 weeks ago

    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong big query...

  • Data Engineer

    3 weeks ago

    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    5 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    3 months ago

    Gurugram, India Siemens Energy Full time

    Data Engineer About the Role Location India Haryana Gurugram Company Siemens Energy Industrial Turbomachinery India Private Limited Organization EVP Global Functions Business Unit Digital Core Full / Part time Full-time Experience Level Experienced Professional A Snapshot of Your Day Data Engineer is an engineering role within a data...

  • Data Engineer

    4 months ago

    Gurugram, India Circle K Full time

    JOB DESCRIPTION Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with 16,700 stores in 31 countries, serving more than 9 million customers each day. It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported...

  • Data Engineer

    3 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    1 week ago

    gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    4 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    4 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Senior Data Engineer

    6 days ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About the Role:Eucloid Data Solutions Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our Data Platform team. The successful candidate will have hands-on expertise in Databricks and will be responsible for designing and building data infrastructure to support various business applications.Key Responsibilities:Design, implementation, and...

  • Data Engineer

    2 months ago

    Gurugram, India Publicis Groupe Full time

    Job Description Description: As a Data Engineer, you will develop and deliver solutions that enable our agency teams to win in a very competitive marketplace. The right candidate will be somebody who is motivated to get it done, loves to continually learn and builds software utilizing modern technologies and strong engineering practices. Our team is...

  • Data Engineer

    5 months ago

    Gurugram, India TransOrg Analytics Full time

    Location : Gurgaon/Mumbai Job ID : DE2008 Job Type : Full time Experience : 2-6 years Why would you like to join us? TransOrg Analytics, an award winning – Big Data and Predictive analytics- company, offers advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, UK, Singapore and the Middle East. Our products...