Data Engineer

1 week ago

west bengal, India Pinnacle Infotech Full time

Company Overview

Pinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive swift career growth with Pinnaclites

Job Title:

MLOps Engineer

Job Summary: As an MLOps Engineer, you will be responsible for building, deploying, and maintaining the infrastructure required for machine learning models and ETL data pipelines. You will work closely with data scientists, and software developers to streamline our machine learning operations, manage data workflows, and ensure that the ML solutions are scalable, reliable, and secure.

Location- Durgapur/Jaipur/Madurai

Qualifications:

Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field.
3+ years of experience in MLOps, data engineering, or a similar role.
Proficiency in programming languages such as Python, Spark, and SQL.
Experience with ML model deployment frameworks and tools (e.g., MLflow).
Hands-on experience with cloud platforms (AWS, Azure, GCP) and infrastructure management.
Familiarity with containerization and orchestration tools (Docker, Kubernetes).
Understanding of DevOps practices, CI/CD pipelines, and monitoring tools.
Excellent problem-solving skills and the ability to work independently and as part of a team.

Key Responsibilities:

Data Engineering and Pipeline Management:

Design, develop, optimize, and maintain ETL processes and data pipelines to collect, process, and store data from multiple sources.
Ensure data quality, integrity, and consistency across various databases.
Collaborate with data scientists to make data available in the right format and speed for machine learning.
Implement and manage data security and privacy protocols as per industry standards.

ML Operations and Deployment:

Design, build, and optimize scalable and reliable ML deployment pipelines.
Develop CI/CD pipelines for automated ML model training, testing, and deployment.
Implement and manage containerization (Docker) and orchestration tools (e.g., Kubernetes) for ML workflows.
Monitor and troubleshoot model performance and infrastructure, ensuring smooth operation in production environments.

Infrastructure Management:

Manage cloud infrastructure (AWS, GCP, Azure) to support data and ML operations.
Optimize and scale ML and data workflows to handle large-scale datasets.
Set up and manage monitoring tools for infrastructure and application performance.

Collaboration and Best Practices:

Work closely with data science, software development, and product teams to understand project needs and optimize model performance.
Develop and document best practices, guidelines, and protocols for ML lifecycle management.

Interested candidates, please share your resume at sunitas@pinnacleinfotech.com

  • Data engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest,...

  • Data Engineer

    2 weeks ago

    west bengal, India Pinnacle Infotech Full time

    Company OverviewPinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • Data Engineer

    1 week ago

    west bengal, India Pinnacle Infotech Full time

    Company OverviewPinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • Data engineer

    3 days ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; Py Spark; Python; AWS Step Function Responsibilities:  Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. ...

  • Data Engineer

    1 week ago

    west bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...

  • Data engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 4+ to 10+ Years Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, Dynamo DB, Python, Py Spark, SQL, PL/SQL. Key Responsibilities: Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue,...

  • Data Engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities:Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL processes...

  • Data Engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step Function Responsibilities: Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. Develop and manage...

  • Data Engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step Function Responsibilities:  Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. ...

  • Azure data engineer

    2 months ago

    west bengal, India Tata Consultancy Services Full time

    Job Title- Databricks Developer Relevant Experience (in Yrs) 6 to 12 YRs Technical/Functi onal Skills · Minimum 5 years + working exp as Databricks Developer · Minimum 3 years + working exp on PySpark and AWS Experience Required 5 years+ Roles & Responsibilities · 5+ years relevant and progressive data engineering experience · Deep Technical knowledge...

  • Senior Data Engineer

    2 weeks ago

    west bengal, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Data Engineer

    3 weeks ago

    west bengal, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Networking Managed Services Engineer-l2

    3 weeks ago

    Kolkata, West Bengal, India NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...

  • Azure data engineer

    2 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database Engineer Experience Required: 3-15 Years Location: Kolkata Job Type: Full-time Must Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; Snowflake Key Responsibilities: - Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB. - Develop, optimize,...

  • Azure data engineer

    3 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:- Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.- Develop, optimize, and automate...

  • Azure data engineer

    3 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB .Develop, optimize, and...

  • AWS Data Engineer

    3 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:- Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB.- Build and maintain scalable ETL pipelines using AWS Glue...

  • AWS Data Engineer

    3 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB .Build and maintain scalable ETL pipelines using AWS...

  • AWS Data Engineer

    2 months ago

    west bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 4+ to 10+ Years Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL. Key Responsibilities: Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step...

  • AWS Data Engineer

    3 months ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...