Senior ML Data Pipeline Engineer

7 days ago

Bengaluru India Calix Full time

Job Description Calix provides the cloud, software platforms, systems and services required for communications service providers to simplify their businesses, excite their subscribers and grow their value. Job Description: As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining scalable data architectures that support machine learning models and analytics. You will work closely with data scientists, machine learning engineers, and other stakeholders to ensure that our data infrastructure meets the demands of our ML initiatives. Your expertise will drive the development of eBicient data pipelines, enhance data quality, and optimize performance for our ML workloads. Key Responsibilities: - Design, develop, and maintain scalable data pipelines and ETL processes to support machine learning/GenAI applications. - Architect, implement, and optimize workflow orchestration using Apache Airflow and Google Cloud Composer, ensuring robust scheduling, monitoring, and management of complex data pipelines. - Collaborate with data scientists and ML engineers to understand data requirements and ensure seamless integration of data into ML models. - Implement data governance practices to ensure data quality, consistency, and compliance with industry standards. - Optimize data storage solutions for performance and cost-eBectiveness, utilizing cloud services (GCP). - Monitor and troubleshoot data pipeline performance issues, implementing improvements as necessary. - Develop and maintain documentation for data architecture, data flows, and processes to support knowledge sharing within the team. - Stay updated on the latest data engineering and machine learning trends, tools, and best practices to continuously improve our processes and technologies. - Mentor and provide guidance to junior data engineers and other team members. - Perform data ingestion, data processing and feature engineering tasks. - Operate and administration of production DB: SQL, NoSQL, Vector and Graph. - Qualifications: - Bachelor's or master's degree in computer science, Engineering, Data Science, or a related field. - 5+ years of experience as a Data Engineer, with a focus on machine learning applications. - Strong programming skills in Python or Java. - Strong experience with data processing frameworks (e.g., Apache Spark, Apache Kafka) and ETL tools. - Solid understanding of databases (SQL and NoSQL) and data warehousing solutions (e.g., Amazon Redshift, Google BigQuery). - Experience with real-time data processing and streaming analytics. - Experience with containerization and orchestration tools (Docker, Kubernetes) - Experience with cloud platforms (AWS, Azure, GCP) and their data services. - Experience with version control systems (e.g., Git) and CI/CD pipelines. - Knowledge of machine learning concepts and algorithms is a plus. - Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment. - Strong communication skills, with an ability to convey complex technical concepts to non-technical stakeholders. Preferred Qualifications: - Knowledge of data governance and compliance regulations. - Knowledge of machine learning concepts and algorithms is a plus. - Familiarity with MLOps practices and tools.

  • Senior ML Data Pipeline Engineer

    2 weeks ago

    Bengaluru, India Calix Full time

    Calix provides the cloud, software platforms, systems and services required for communications service providers to simplify their businesses, excite their subscribers and grow their value. Job Description : As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining scalable data architectures that support machine...

  • Senior ML Data Pipeline Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Calix Full time ₹ 7,00,000 - ₹ 21,00,000 per year

    Calix provides the cloud, software platforms, systems and services required for communications service providers to simplify their businesses, excite their subscribers and grow their value.Job Description: As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining scalable data architectures that support machine learning...

  • Data/ml ops engineer

    4 hours ago

    Bengaluru, India NTT DATA, Inc. Full time

    We are looking for a MLOps Engineer / Data Ops Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines. You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...

  • Data/ML Ops Engineer

    2 weeks ago

    Bengaluru, India NTT DATA, Inc. Full time

    We are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines. You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...

  • Data/ml ops engineer

    2 days ago

    Bengaluru, India NTT DATA, Inc. Full time

    We are looking for a MLOps Engineer / Data Ops Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines.You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...

  • Data/ML Ops Engineer

    1 week ago

    Bengaluru, India NTT DATA, Inc. Full time

    We are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines.You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...

  • Data/ML Ops Engineer

    1 week ago

    Bengaluru, India NTT DATA, Inc. Full time

    We are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines.You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...

  • Data/ML Ops Engineer

    2 weeks ago

    Bengaluru, India NTT DATA, Inc. Full time

    We are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines.You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...

  • Senior ML Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tytan Technology Inc. Full time

    We're hiring a Senior ML Engineer to work with one of our clients - a well-funded AI startup at the intersection of artificial intelligence, private equity, and the energy transition. You'll help build AI-driven platforms transforming how a $30Bn+ investment ecosystem operates.What You'll DoBuild and maintain scalable data pipelines and ETL processes for...

  • Data/ML Ops Engineer

    1 week ago

    Bengaluru, India NTT DATA, Inc. Full time

    We are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines.You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...