Data Engineer

4 weeks ago

Gurgaon, Haryana, India Coders Brain Technology Private Limited Full time
About Us

Coders Brain Technology Private Limited is a global leader in digital and business solutions, partnering with clients to simplify, strengthen, and transform their businesses. We ensure the highest levels of certainty and satisfaction through a deep-set commitment to our clients, comprehensive industry expertise, and a global network of innovation and delivery centers.

Job Title

Dev+ML+Data Engineer

Job Description

We are seeking a highly skilled Dev+ML+Data Engineer to join our team. As a key member of our engineering team, you will be responsible for developing and managing end-to-end machine learning pipelines, ensuring seamless integration and deployment of ML models, and optimizing data processing frameworks.

Key Responsibilities
  1. Data Engineering & Processing
  • Design, build, and maintain scalable data pipelines using Apache Spark and Spark Streaming for real-time data processing.
  • Develop and implement data ingestion, transformation, and enrichment processes to support machine learning workflows.
  • Optimize and troubleshoot Spark jobs and streaming pipelines for performance and reliability.
Machine Learning Lifecycle Management
  • Manage the full ML lifecycle, including model development, deployment, monitoring, and maintenance.
  • Implement and automate CI/CD pipelines for ML models using frameworks and tools that support continuous integration and delivery.
  • Collaborate with data scientists to integrate and operationalize machine learning models into production environments.
Infrastructure & Operations
  • Utilize Docker and Kubernetes to containerize and orchestrate applications and ML models, ensuring scalability and reliability.
  • Develop and maintain infrastructure as code (IaC) for efficient deployment and management of resources.
  • Monitor system performance and resolve issues related to data processing and ML operations.
Requirements
  • Proficiency in Apache Spark and Spark Streaming for real-time data processing.
  • Experience with ML lifecycle management, including deployment and monitoring of ML models.
  • Strong understanding of CI/CD practices and tools specific to ML models.
  • Hands-on experience with Docker and Kubernetes for containerization and orchestration.
  • Proficiency in Python for data engineering and ML tasks.
  • Practical experience in building and managing streaming pipelines.
Soft Skills
  • Strong problem-solving abilities and analytical skills.
  • Excellent communication skills with the ability to convey complex technical concepts to non-technical stakeholders.
  • Ability to work effectively both independently and in a collaborative team environment.
Education & Experience

Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.

  • Data Engineer

    1 month ago

    Gurgaon, Haryana, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Title: Data EngineerAt IFlowTech Solutions Private Limited, we are seeking a highly skilled Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data pipelines and architectures to support business...

  • Senior Network Engineer

    3 weeks ago

    Gurgaon, Haryana, India NTT DATA Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    1 month ago

    Gurgaon, Haryana, India Nutrabay Full time

    Data EngineerWe are seeking a skilled Data Engineer to help us drive innovation in data engineering concepts and technologies. The ideal candidate will be responsible for designing and implementing data pipelines for extracting, transforming, and loading data from various sources to our data warehouses and data lakes.Key Responsibilities:Design and implement...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India The Nielsen Company Full time

    About the RoleNielsen is seeking a skilled Data Engineer to join our OpIntel team. As a Data Engineer, you will be responsible for designing, developing, and supporting complex data engineering software solutions for analytical data storage. You will work closely with offshore team members in the software development lifecycle process.Key...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India The Nielsen Company Full time

    About the RoleNielsen is seeking a highly skilled Data Engineer to join our OpIntel team. As a Data Engineer, you will be responsible for designing, developing, and supporting complex data engineering software solutions for analytical data storage.Key ResponsibilitiesDesign and develop highly complex data engineering software solutions for analytical data...

  • Data Engineer

    1 month ago

    Gurgaon, Haryana, India Paddlelift Full time

    Job Title: Data EngineerAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Paddlelift. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data pipelines and ETL processes.Key Responsibilities:Design and develop data pipelines and ETL processes to extract, transform, and load data from...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India AXA Group Full time

    Data Engineering at AXA GroupWe are seeking an experienced Data Engineer to join our team at AXA Group. As a key member of our Data Engineering team, you will be responsible for designing, developing, and maintaining our Enterprise data lake.Key Responsibilities:Design and develop ETL pipelines using Informatica Power Center and SQL Stored ProceduresWork...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Truelancer Full time

    Job Title: Data EngineerJob Summary:Truelancer is seeking a skilled Data Engineer to design and build data pipelines using Spark-SQL and PySpark in Azure Databricks. The ideal candidate will have experience with ETL pipelines using ADF and a strong understanding of Lakehouse architecture in ADLS/Databricks.Key Responsibilities:• Design and build data...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Cloud Data ScientistAbout the Role:We are seeking a skilled Cloud Data Scientist to join our team at BayOne Solutions. As a Cloud Data Scientist, you will be responsible for designing and implementing data engineering solutions on cloud platforms like Azure, AWS, and GCP.Key Responsibilities:• Design and implement data engineering solutions on...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India HuQuo Full time

    Data Engineer Role at HuQuoAs a Data Engineer at HuQuo, you will be responsible for designing, building, and maintaining large-scale data pipelines that meet our business requirements. Your specific responsibilities will include creating and optimizing data pipeline architecture, assembling complex data sets, and identifying opportunities for process...

  • Data Engineer

    1 month ago

    Gurgaon, Haryana, India AXA Group Full time

    Job Title: Data EngineerAXA XL is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our Enterprise data lake.Key Responsibilities:Design and develop ETL pipelines using Informatica PowerCenter and SQL Stored Procedures.Develop and maintain SQL Server...

  • Eucloid Principal Data Consultant

    3 weeks ago

    Gurgaon, Haryana, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data Solutions Pvt LtdEucloid Data Solutions Pvt Ltd is a Data and Growth Intelligence firm. Our mission is to empower businesses to make smarter decisions and drive digital growth through unified data platforms and digital commerce solutions.We have deep partnerships with leading Data & Cloud vendors in the industry. These range from Marketing...

  • Data Engineer

    1 month ago

    Gurgaon, Haryana, India Material Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Material. The ideal candidate will have extensive experience with AWS Glue, Apache Airflow, Kafka, SQL, Python, and DataOps tools and technologies.Key Responsibilities:Design and Develop Data Pipelines: Develop robust and scalable data pipelines using AWS Glue, Apache...

  • Senior Networking Engineer

    2 weeks ago

    Gurgaon, Haryana, India NTT DATA Full time

    Job OverviewNTT DATA is seeking a skilled Technical Services Implementation Engineer to provide technical support to clients. This role involves remotely assisting clients within service level agreements (SLAs), installing and configuring software and hardware, resolving incidents, performing root cause analysis, and adhering to relevant processes.Key...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Synechron Full time

    At Synechron, we're looking for a talented Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities• Develop, construct, test, and maintain architectures such as databases and large-scale processing...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Moody's Full time

    At Moody\u0027s, we are seeking a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing large-scale data solutions with a solid understanding of data modeling, data processing, and data warehousing.ResponsibilitiesDesign and develop database/ETL operations for multiple critical ratings applications...

  • Data Engineer

    1 month ago

    Gurgaon, Haryana, India Gartner Full time

    About the RoleGartner is seeking a skilled Data Engineer to join our Digital Product Technologies team. As a Data Engineer, you will play a critical role in designing, building, and maintaining data-driven components that support business needs. This is a high-velocity agile team responsible for developing and maintaining components crucial to...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Gartner Full time

    About the RoleGartner is seeking an experienced Cloud Data Engineer to join our Data Engineering team. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining scalable cloud-based data pipelines to support our business needs. This role is a key member of the Data Engineering team, working closely with cross-functional teams...

  • Data Engineer

    1 month ago

    Gurgaon, Haryana, India OMEGA HIRES CONSULTANCY Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at OMEGA HIRES CONSULTANCY. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines using GCP tools such as Cloud Dataflow, Cloud Composer, and Cloud Functions.Key Responsibilities:Extract data from various...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Elite recruitments Full time

    Job Title: Data EngineerJob Description:We are looking for a skilled Data Engineer to join our team at Elite Recruitments. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using Databricks.Key Responsibilities:Design and implement efficient data pipelines using Databricks.Collaborate with data...