Data Engineer

1 month ago

GurgaonGurugram, IN Coders Brain Technology Private Limited Full time

Job Title : ML - Data Engineer

Location : Gurugram, Haryana

Job Type : Full-Time

Notice period : Immediate Joiners Only

About Us :

Coders Brain is a global leader in its services, digital and business solutions that partners with its clients to simplify, strengthen and transform their businesses. We ensure the highest levels of certainty and satisfaction through a deep-set commitment to our clients, comprehensive industry expertise and a global network of innovation and delivery centers. We achieved our success because of how successfully we integrate with our clients.

- Quick Implementation : We offer quick implementation for the new onboarding client.

- Experienced Team : We've built an elite and diverse team that brings its unique blend of talent, expertise, and experience to make you more successful, ensuring our services are uniquely customized to your specific needs.

- One Stop Solution : Coders Brain provides end-to-end solutions for the businesses at an affordable price with uninterrupted and effortless services.

- Ease of Use : All of our products are user friendly and scalable across multiple platforms. Our dedicated team at Coders Brain implements keeping the interest of enterprise and users in mind.

- Secure : We understand and treat your security with utmost importance. Hence we blend security and scalability in our implementation considering long term impact on business benefit.

Role Overview :

As a Dev+ML+Data Engineer you will be responsible for developing and managing end-to-end machine learning pipelines, ensuring seamless integration and deployment of ML models, and optimizing data processing frameworks. You will work closely with data scientists, engineers, and stakeholders to build robust, scalable, and efficient solutions in a real-time environment.

Key Responsibilities :

Data Engineering & Processing :


- Design, build, and maintain scalable data pipelines using Apache Spark and Spark Streaming for real-time data processing.

- Develop and implement data ingestion, transformation, and enrichment processes to support machine learning workflows.

- Optimize and troubleshoot Spark jobs and streaming pipelines for performance and reliability.

Machine Learning Lifecycle Management :

- Manage the full ML lifecycle, including model development, deployment, monitoring, and maintenance.

- Implement and automate CI/CD pipelines for ML models using frameworks and tools that support continuous integration and delivery.

- Collaborate with data scientists to integrate and operationalize machine learning models into production environments.

Infrastructure & Operations :

- Utilize Docker and Kubernetes to containerize and orchestrate applications and ML models, ensuring scalability and reliability.

- Develop and maintain infrastructure as code (IaC) for efficient deployment and management of resources.

- Monitor system performance and resolve issues related to data processing and ML operations.

Collaboration & Communication :

- Work closely with cross-functional teams, including data scientists, software engineers, and product managers, to understand requirements and deliver solutions that meet business needs.

- Document and communicate technical processes, workflows, and best practices to ensure alignment and knowledge sharing within the team.

Must-Have Skills :

Technologies :


- Proficiency in Apache Spark and Spark Streaming for real-time data processing.

- Experience with ML lifecycle management, including deployment and monitoring of ML models.

- Strong understanding of CI/CD practices and tools specific to ML models.

- Hands-on experience with Docker and Kubernetes for containerization and orchestration.

- Proficiency in Python for data engineering and ML tasks.

- Practical experience in building and managing streaming pipelines.

Soft Skills :

- Strong problem-solving abilities and analytical skills.

- Excellent communication skills with the ability to convey complex technical concepts to non-technical stakeholders.

- Ability to work effectively both independently and in a collaborative team environment.

Nice-to-Have Skills : Experience with Scala for Spark applications and data processing tasks.

Office Requirements :

Initial Onboarding : The position requires a mandatory in-office presence for the first month of onboarding.

Post-Onboarding : Flexible work arrangement with an expectation of 50% office presence per month thereafter.

Education & Experience : Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
(ref:hirist.tech)

  • Data Engineer

    1 month ago

    Gurgaon/Gurugram, IN CRESCENDO GLOBAL LEADERSHIP HIRING INDIA PRIVATE L Full time

    Exciting opportunity for a Data Engineer with 4-7 years' experience to lead analytic strategies, technical requirements, and data solutions for a major insurance client in our dynamic team.Location : PAN INDIA(Remote)Your Future Employer :This company is a leading operations management and analytics provider that empowers businesses to achieve strategic...

  • Data Engineer

    1 month ago

    Gurgaon/Gurugram, IN Paddlelift Full time

    Job Description :You will work closely with the data analytics team to analyze and interpret data, develop data visualizations, and assist in data-driven decision-making processes. This includes collecting and cleaning data, conducting data analysis using statistical software, and creating reports and presentations to communicate insights.Requirements : -...

  • Data Engineer

    1 month ago

    Gurgaon/Gurugram, IN curatAId Full time

    Job Description :Expertise in Azure cloud tools for our client, a global business and technology services firm. In this role, you will be integral to designing, developing, and maintaining the data infrastructure. The ideal candidate will have extensive experience with cloud-based data technologies, particularly in Azure, and a proven track record of...

  • Manager - Data Engineering

    6 months ago

    Gurgaon/Gurugram, IN Spectral Consultant Full time

    Spectral Consultants is hiring for the role of Data Engineering- Manager with one of the financial services organisation.Experience : 10+ yearsShould have experience in - Enterprise Data EnvironmentResponsibilities :- Extensive experience with Azure Cloud strategies & industry best practices- Excellent skills in data management, data modelling, data...

  • Senior Data Engineer

    1 month ago

    Gurgaon/Gurugram, IN Altudo Full time

    We have a unique career opportunity for an experienced Data Engineer to play a key role in the growth of the Analytics practice. You will work with Altudo' s clients to deliver cutting-edge data & analytics solutions using modern data platforms such as Databricks, Snowflake and Microsoft Fabric. You will play a key role in leading complex engagements. In...

  • Data Engineer

    1 month ago

    Gurgaon/Gurugram, IN IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Role : Data Engineerlocation : GurugramExperience : Must have 5+ Years Primary Skills : Python, Pyspark, SQL, Hive, Data Ware Housing, Data Modelling, Tableau/Power BI, Data Migration, Source to Target MappingKey Responsibilities :- Independently run workshops and interviews with appropriate stakeholders (data owners from Business, Service and Product teams)...

  • Data Engineer

    1 month ago

    Gurgaon/Gurugram, IN Drimlite Full time

    Job Title : Data EngineerLocation : Gurugram, DelhiExperience : 3-5 YearsBudget : 24 LPAWork Mode : Work From Office (WFO)Interview Mode : VirtualMust-Have Skills : PySpark, Databricks, ML Flow, Azure DevOps, SQLJob Description :We are seeking a skilled Data Engineer to design, build, and maintain data pipelines, data architectures, and ETL processes using...

  • Lead Data Engineer

    1 month ago

    Gurgaon/Gurugram, IN RENOUS EXTENSERVE PRIVATE LIMITED Full time

    One our leading client is hiring for "Lead Data Engineer"Below are the details -Position - Lead Data Engineer Experience - 8+YearsJob type - ContractualLocation - GurgaonCTC - Best in the IndustryJob Description : We're looking for people to join our engineering team in building upon this success, as we grow to play a key part in redefining the future of...

  • IT Manager

    1 month ago

    Gurgaon/Gurugram, IN Spectral Consultants – Search & Recruitment firm Full time

    Job Description : We are looking for an experienced Cloud and Data Manager to provide strategic and technical direction to help deliver our next-generation solutions using cloud-based technologies. This role requires expertise around data quality and maintaining the production environment, where the delivered solutions are executing on daily basis. You must...

  • Data Engineer

    1 month ago

    Gurgaon/Gurugram, IN OMEGA HIRES CONSULTANCY Full time

    Job Description :- Design, build, and maintain scalable and efficient data pipelines using GCP tools such as Cloud Dataflow, Cloud Composer, and Cloud Functions.- Extract data from various sources (e. , databases, files, APIs) and transform it into a suitable format for analytics.- Load data into GCP data stores like BigQuery, Cloud Storage, and Data...

  • Data Engineer

    3 weeks ago

    Bangalore/Gurgaon/Gurugram, IN InstaTalent Recruit LLP Full time

    Data Engineer (Snowflake). Required : Insta Talent Reruit LLP, a leading company in the None industry, is seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for building and running the data pipelines and services that are required to support business functions, reports, and dashboards. We heavily rely on...

  • AWS Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN Randstad Digital Full time

    Role : AWS Data : 5+ YearsLocation : Gurgaon (WFO)Must have : Databricks, AWS, SQL, Python, PySpark.- Looking for Immediate Joiners onlyWe are seeking a skilled Backend Data Engineer to join our dynamic team. The ideal candidate will have expertise in Databricks, AWS, SQL, Python, and PySpark, with a proven ability to design and implement efficient data...

  • Petonic Infotech

    1 month ago

    Gurgaon/Gurugram, IN Petonic Infotech Pvt. Ltd. Full time

    Job Title : Senior Data EngineerLocation : Gurgaon (Work from Office)Company Overview :Petonic is an innovative leader in harnessing AI-driven solutions to solve complex challenges. We empower our clients by enabling data-driven insights and advanced analytics. Join us as we build transformative AI systems and revolutionize industries.Job Summary :We are...

  • Lead Data Engineer

    1 month ago

    Gurgaon/Gurugram, IN Acquire Bright Minds Full time

    Job Description : Lead Data EngineerLocation : GurgaonExperience : 8 to 10 YearsNotice Period : 20 Days :Data Integration and ETL :- Design, develop, and implement efficient data integration and ETL pipelines using Talend or other relevant tools.- Ensure data quality, consistency, and accuracy throughout the data lifecycle.- Optimize ETL processes for...

  • AWS Data Engineer

    1 month ago

    Gurgaon/Gurugram, IN True Tech Professionals Full time

    Job Description :We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL. The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring...

  • Data Engineer II

    1 month ago

    Pune/Gurgaon/Gurugram, IN Hiring Infinity Full time

    SDE2 Data EngineerAbout :My client is a generative AI company dedicated to transforming workplaces with innovative AI solutions and micro-applications built on the GenAI stack. Our mission is to enhance efficiency and scalability across various industries, including education, legal and compliance, and auditing and taxation. We leverage deep industry...

  • Data Quality Engineer

    1 month ago

    Gurgaon/Gurugram, IN True Tech Professionals Full time

    We are seeking a highly skilled and detail-oriented Data Quality Engineer to join our team. The ideal candidate will have a strong background in SQL, hands-on experience with Python for ETL testing, and a proven track record of ensuring the accuracy and integrity of financial data. This role requires a meticulous attention to detail, strong problem-solving...

  • BluePi - Vice President - Data Engineering

    1 month ago

    Gurgaon/Gurugram, IN Bluepi Consulting private limited Full time

    About BluePi :BluePi Consulting partners with organizations to help them achieve higher levels of maturity. Founded in 2012, has today grown to serve several established organizations across India & Australia. Self-funded, the organization has its sales offices in Mumbai & Sydney, besides its headquarters in Gurgaon. For over a decade, BluePi has helped...

  • StatusNeo - Data Engineer - ETL

    1 month ago

    Remote/Gurgaon/Gurugram, IN StatusNeo Technology Consulting Pvt. Ltd Full time

    Role : Data EngineerLocation : Remote / Gurgaon, Haryana (Hybrid) Full-timeExperience : 4+ yearsPrimary skills : Apache Airflow, SQL Queries, Python, GCP, Big Query, ETL/DWH toolsJob Description : Role Purpose :In data engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for...

  • Snowflake Developer

    1 month ago

    Pune/Gurgaon/Gurugram, IN Randstad Digital Full time

    Hiring for Snowflake DeveloperExperience : 4-8 YearsLocation : Gurgaon/Pune (5 Days WFO)Need only Immediate JoinersWe are seeking a highly skilled and experienced Senior Snowflake Developer to join our team. The ideal candidate will have a strong background in Snowflake development and a deep understanding of data engineering, data applications, and data...