Data Engineer

2 months ago

Gurugram, India Coders Brain Technology Private Limited Full time

Job Title : ML - Data Engineer

Location : Gurugram, Haryana

Job Type : Full-Time

Notice period : Immediate Joiners Only

About Us :

Coders Brain is a global leader in its services, digital and business solutions that partners with its clients to simplify, strengthen and transform their businesses. We ensure the highest levels of certainty and satisfaction through a deep-set commitment to our clients, comprehensive industry expertise and a global network of innovation and delivery centers. We achieved our success because of how successfully we integrate with our clients.

- Quick Implementation : We offer quick implementation for the new onboarding client.

- Experienced Team : We've built an elite and diverse team that brings its unique blend of talent, expertise, and experience to make you more successful, ensuring our services are uniquely customized to your specific needs.

- One Stop Solution : Coders Brain provides end-to-end solutions for the businesses at an affordable price with uninterrupted and effortless services.

- Ease of Use : All of our products are user friendly and scalable across multiple platforms. Our dedicated team at Coders Brain implements keeping the interest of enterprise and users in mind.

- Secure : We understand and treat your security with utmost importance. Hence we blend security and scalability in our implementation considering long term impact on business benefit.

Role Overview :

As a Dev+ML+Data Engineer you will be responsible for developing and managing end-to-end machine learning pipelines, ensuring seamless integration and deployment of ML models, and optimizing data processing frameworks. You will work closely with data scientists, engineers, and stakeholders to build robust, scalable, and efficient solutions in a real-time environment.

Key Responsibilities :

Data Engineering & Processing :


- Design, build, and maintain scalable data pipelines using Apache Spark and Spark Streaming for real-time data processing.

- Develop and implement data ingestion, transformation, and enrichment processes to support machine learning workflows.

- Optimize and troubleshoot Spark jobs and streaming pipelines for performance and reliability.

Machine Learning Lifecycle Management :

- Manage the full ML lifecycle, including model development, deployment, monitoring, and maintenance.

- Implement and automate CI/CD pipelines for ML models using frameworks and tools that support continuous integration and delivery.

- Collaborate with data scientists to integrate and operationalize machine learning models into production environments.

Infrastructure & Operations :

- Utilize Docker and Kubernetes to containerize and orchestrate applications and ML models, ensuring scalability and reliability.

- Develop and maintain infrastructure as code (IaC) for efficient deployment and management of resources.

- Monitor system performance and resolve issues related to data processing and ML operations.

Collaboration & Communication :

- Work closely with cross-functional teams, including data scientists, software engineers, and product managers, to understand requirements and deliver solutions that meet business needs.

- Document and communicate technical processes, workflows, and best practices to ensure alignment and knowledge sharing within the team.

Must-Have Skills :

Technologies :


- Proficiency in Apache Spark and Spark Streaming for real-time data processing.

- Experience with ML lifecycle management, including deployment and monitoring of ML models.

- Strong understanding of CI/CD practices and tools specific to ML models.

- Hands-on experience with Docker and Kubernetes for containerization and orchestration.

- Proficiency in Python for data engineering and ML tasks.

- Practical experience in building and managing streaming pipelines.

Soft Skills :

- Strong problem-solving abilities and analytical skills.

- Excellent communication skills with the ability to convey complex technical concepts to non-technical stakeholders.

- Ability to work effectively both independently and in a collaborative team environment.

Nice-to-Have Skills : Experience with Scala for Spark applications and data processing tasks.

Office Requirements :

Initial Onboarding : The position requires a mandatory in-office presence for the first month of onboarding.

Post-Onboarding : Flexible work arrangement with an expectation of 50% office presence per month thereafter.

Education & Experience : Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
(ref:hirist.tech)

  • Data Engineers/Modelers

    3 weeks ago

    Gurugram, India NTT DATA Services Full time

    Data Engineers/Modelers - 8+ years of experience mAnalyticsResponsibilitiesDevelop and implement data pipeline for ingestion , loading and transformation of data sets from other systemsDesign and develop logical and physical data models as per business requirements.Perform data analysis to identify relationships, patterns and trends in dataEnsure data...

  • Data Engineer

    2 weeks ago

    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Eucloid - Data Engineer - Azure Databricks

    5 months ago

    Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Senior Data Engineer

    4 days ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...

  • Data Engineer

    2 weeks ago

    gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    3 weeks ago

    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong big query...

  • Data Engineer

    3 weeks ago

    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong big query...

  • Data Engineer

    3 weeks ago

    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    3 weeks ago

    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    3 weeks ago

    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    5 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    3 months ago

    Gurugram, India Siemens Energy Full time

    Data Engineer About the Role Location India Haryana Gurugram Company Siemens Energy Industrial Turbomachinery India Private Limited Organization EVP Global Functions Business Unit Digital Core Full / Part time Full-time Experience Level Experienced Professional A Snapshot of Your Day Data Engineer is an engineering role within a data...

  • Data Engineer

    4 months ago

    Gurugram, India Circle K Full time

    JOB DESCRIPTION Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with 16,700 stores in 31 countries, serving more than 9 million customers each day. It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported...

  • Data Engineer

    3 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    6 days ago

    gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    4 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    4 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Senior Data Engineer

    4 days ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About the Role:Eucloid Data Solutions Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our Data Platform team. The successful candidate will have hands-on expertise in Databricks and will be responsible for designing and building data infrastructure to support various business applications.Key Responsibilities:Design, implementation, and...

  • Data Engineer

    2 months ago

    Gurugram, India Publicis Groupe Full time

    Job Description Description: As a Data Engineer, you will develop and deliver solutions that enable our agency teams to win in a very competitive marketplace. The right candidate will be somebody who is motivated to get it done, loves to continually learn and builds software utilizing modern technologies and strong engineering practices. Our team is...

  • Data Engineer

    5 months ago

    Gurugram, India TransOrg Analytics Full time

    Location : Gurgaon/Mumbai Job ID : DE2008 Job Type : Full time Experience : 2-6 years Why would you like to join us? TransOrg Analytics, an award winning – Big Data and Predictive analytics- company, offers advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, UK, Singapore and the Middle East. Our products...