Data Engineering Manager

1 month ago

Coimbatore, India Cloud Destinations Full time

Company Overview :

Cloud Destinations is headquartered in San Ramon, CA. We are a fast-growing organization focused on infrastructure projects and professional services related to Large Scale Cloud Migrations, Multi-Cloud Operations (AWS, Azure, Google Cloud, VMware, Rack Space, etc.), Dev Ops, RNOC, Security Operations, Datacenter, UC Collaboration, etc.

We have a strong technical and leadership team, with offices located globally. We believe our successes come from our teamwork and mutual respect for each other's talents and unique perspectives.

Job Title : Data Engineering Manager.

Experience : 10+ Years.

Location : Coimbatore.

Type : Full-Time.

Experience Level : Senior.

About the Role :

We are seeking a skilled Senior Data Engineering Manager to join our team. The ideal candidate will have a strong background in cloud platforms, big data processing, data lakes, data modeling, data warehousing, relational databases, ML/AI concepts, architecture design principles, and various tools and technologies.

Management Responsibilities :

- Own ongoing development and support of our data products using data product management principles and processes.

- Develop roadmaps that deliver new capabilities (e., new data domains, data models) and address performance and platform operating costs opportunities.

- Lead a team of Data Engineers, including mentorship and skills development.

- Build scalable methodologies to mature and accelerate our data engineering and data product development practices.

- Establish data visualization (e., reporting) training and support best practices for the company.

- Develop a MLOps / DataOps operating model for the team.

- Manage data platform spend within budget.

- Work with our technology partners and data analysts to ensure high-quality, usable data is captured to support reliable business-facing analytics.

- Keep abreast of new advances in data platform tools and best practices across retail and related domains.

- Partner with VP and Sr Directors to lead team and company data change initiatives.

- Leadership and Management Experience.

- Proven experience in leading and managing a data engineering team.

- Strong skills in project management, team building, and performance evaluation.

- Ability to mentor and develop team members.

- Experience in strategic planning and executing data engineering initiatives.

Key Skills :

- Cloud Platforms Expertise in one major cloud platform (e., AWS, Azure, Google Cloud).

- Big Data Processing Proficiency in a big data framework (e., Hadoop, Spark, Flink).

- Data Lake Experience with a data lake platform (e.g , AWS S3, Azure Data Lake, Google Cloud Storage) and an understanding of data lake architecture.

- Data Modeling & Pipelines Proficiency in data modeling and designing data pipelines (ETL/ELT) and an understanding of data modeling techniques and pipeline tools.

- Data Warehousing Expertise in a data warehousing solution (e.g, Redshift, Snowflake, BigQuery) and an understanding of data warehousing concepts.

- Relational Databases Proficiency in a relational database (e.g, MySQL, PostgreSQL, Amazon RDS).

- Machine Learning (ML) and AI Concepts Proficiency in an ML/AI framework (e.g PyTorch, R) and understanding of ML/AI principles, Generative AI and RAG.

- Programming Skills Proficiency in SQL and Python, Java (nice to have).

- Architecture Design Principles Strong grasp of good architecture design principles (e., scalability, reliability, security); Ability to design systems that adhere to these principles.

- Software Development Practices Understanding of the 12-factor app methodology.

Tools and Technologies :

- Data Orchestration and Pipelines : Apache Airflow, DBT, PySpark.

- Project Management and Collaboration : Jira, Confluence.

- Cloud and Container Management : AWS, Azure, Google Cloud, Kubernetes.

- Languages : Python, SQL, Java (nice to have).

- API Management : AWS API Gateway, GraphQL, REST.

- Architecture Frameworks : C4, Microservices, TOGAF.

- Data and Databases : Snowflake, BigQuery, Databricks,, MySQL, Postgres.

- Streaming and ETL : Kafka, Spark.

- Caching : Redis.

- DevOps and CI/CD : Jenkins, Docker, Kubernetes.

Soft Skills :

- Communication : Excellent verbal and written communication abilities.

- Presentation : Proficiency in creating and delivering presentations.

- Problem-Solving : Strong analytical and troubleshooting skills.

- Collaboration : Experience working in cross-functional teams.

- Project Management : Ability to manage and prioritize multiple projects.

Educational and Professional Background :

- Education : Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

- Experience : Proven experience in data architecture or data engineering with successful implementations.

Preferred Qualifications :

- Certifications : AWS Certified Solutions Architect, Google Cloud Professional Data Engineer, Microsoft Certified: Azure Solutions Architect.

- Industry Knowledge : Familiarity with data challenges in retail, finance, or healthcare.

To apply, please submit your resume and a cover letter outlining your qualifications and experience. Cloud Destinations is an equal opportunity employer.

We celebrate diversity and are committed to creating an inclusive environment for all employees.

(ref:hirist.tech)

  • Data Engineer

    7 days ago

    Coimbatore, India StockX Full time

    About the jobWhy you'll love this roleAs a Senior Data Engineer, you will be empowered to leverage data to drive amazing customer experiences and business results. You will own the end to end development of data engineering solutions to support analytical needs of the business. The ideal candidate will be passionate about working with disparate datasets and...

  • Azure Data Engineer

    4 weeks ago

    Coimbatore, India C5i Full time

    Job Description: • We are seeking a highly skilled and experienced Data Engineering Lead to join our team. • The ideal candidate will have a strong background in data engineering, data architecture, and team leadership. • As a Data Engineering Lead, you will be responsible for overseeing the design, development, and maintenance of our data...

  • Azure Data Engineer

    4 weeks ago

    Coimbatore, India C5i Full time

    Job Description: • We are seeking a highly skilled and experienced Data Engineering Lead to join our team. • The ideal candidate will have a strong background in data engineering, data architecture, and team leadership. • As a Data Engineering Lead, you will be responsible for overseeing the design, development, and maintenance of our data...

  • Azure Data Engineer

    4 weeks ago

    Coimbatore, India C5i Full time

    Job Description: • We are seeking a highly skilled and experienced Data Engineering Lead to join our team. • The ideal candidate will have a strong background in data engineering, data architecture, and team leadership. • As a Data Engineering Lead, you will be responsible for overseeing the design, development, and maintenance of our data...

  • Lead Data Engineer

    5 months ago

    Coimbatore, India Presidio Full time

    SEIZE THE OPPORTUNITY TO BE A PART OF SOMETHING GREAT! Presidio is on the leading edge of a technology-driven movement to transform the way business is done, for our customers and our customers' customers. Joining Presidio means immersing yourself in a culture of self-starters, collaborators and innovators who make real, lasting change in the marketplace...

  • Azure Data Engineer

    2 weeks ago

    Coimbatore, India Recro Full time

    Job Title: Azure Data Engineer Location: Remote Experience Required: 3+ Years Job Overview:We seek a skilled Azure Data Engineer with 3+ years of experience, specializing in SQL, Data Modeling, and Azure Data Engineering tools. You will be responsible for building and enhancing data models, managing data pipelines with Azure Data Factory, and working with...

  • Data Engineer

    5 days ago

    Coimbatore, India Dreamz Consultants Full time

    A client of Dreamz and a Global IT Services and Consulting Company requires - Data Engineer - GCPEXP : 3+Location -Coimbatore , kochi , Trivandrum Primary Skills :: GCP, Bigquery, SQL(Advanced) and PythonImmediate to those who can join on or before Nov 30th.Your roleThe ideal candidate will have a strong background in data architecture, ETL processes, and...

  • Data Delivery manager

    6 days ago

    Coimbatore, India Prontoex Consulting Services Pvt Ltd Full time

    Client: LTI Mindtree - HybridFulltime EmploymentLocation: Mumbai/Pune OnlyExperience Range: 13-18 YrsYrsMax Budget 40LPANP : Serving the NP and can join within 40 days Only.We are looking for Data Delivery manager who is having experience in Data Modernization, Data Warehousing . Keyword Tech skills should “ Databricks”/ “Data Engineering”/ Data...

  • Sr. Data Engineer

    21 minutes ago

    Coimbatore, India KGiSL Full time

    We invite you to consider the excellent opportunity as a "Senior Data Engineer" to grow your experience and expertise with our Talent Acquisition Team at KGiSL.Do you want to work onsite, while also being part of a smart tech colleagues working across locations?If yes, go ahead and learn more about this exciting opportunity!Position Title:Senior Data...

  • Senior Data Engineer

    2 weeks ago

    Coimbatore, India MPM Consulting Full time

    Data EngineerAt MPM we are searching for a highly skilled Data Engineers with a minimum of 5 years of experience in data engineering, specifically within the Life Science/ Pharma domain. PRIMARY RESPONSIBILITIES:Designing, developing, and maintaining data pipelines and systems in Azure Cloud environments, with a strong emphasis on Azure Data Lake, Azure...

  • Sr. Data Engineer

    6 hours ago

    Coimbatore, India KGiSL Full time

    We invite you to consider the excellent opportunity as a "Senior Data Engineer" to grow your experience and expertise with our Talent Acquisition Team at KGiSL. Do you want to work onsite, while also being part of a smart tech colleagues working across locations? If yes, go ahead and learn more about this exciting opportunity! Position Title: Senior...

  • Azure Data Engineer

    4 weeks ago

    Coimbatore, India Recro Full time

    Job Title: Azure Data EngineerLocation: Remote | Experience Required: 3-6 YearsSalary: Up to 22 LPA | Notice Period: Within 30 Days or who is serving NoticeJob Description:Are you an Azure Data Engineer with 3-6 years of experience? We're looking for talented professionals who are passionate about data and cloud engineering. If you're experienced in...

  • Artificial Intelligence Engineer

    5 days ago

    coimbatore, India Aptus Data Labs Full time

    Job Description: AI Engineer Location - Hyderabad/Mumbai (Onsite-all 5 days) Looking for resource who can join immediately or within 30 days Technology stacks - Azure ML, Azure, Azure Data Lake, Azure Synapse, Azure Databricks ML, Python, Pyspark, and SQL, Generative AI, deep learning Responsibilities: Develop and implement advanced AI algorithms and...

  • Staff Data Analytics Engineer

    2 weeks ago

    Coimbatore, India Greenlight Full time

    Greenlight is the leading family fintech company on a mission to help parents raise financially smart kids. We proudly serve more than 6 million parents and kids with our award-winning banking app for families. With Greenlight, parents can automate allowance, manage chores, set flexible spend controls, and invest for their family’s future. Kids and teens...

  • Data Engineer

    2 months ago

    Coimbatore, India nference Full time

    Overview:We are seeking a Data Pipeline Engineer to join our team, focusing on the development and maintenance of high-performance data pipelines in distributed systems. The ideal candidate will have a strong background in Python and shell scripting, with a solid understanding of system configurations and monitoring.Key Responsibilities:Design, develop, and...

  • Azure Data Engineer

    2 weeks ago

    Coimbatore, India Recro Full time

    Primary_skills(Must_have)1. SQL Expert - Build [must have]2. Data Modelling – Data structures & common algorithms. Understand E2E Data Flow from Ingestion to Exploitation [must have]3. Azure Databricks / Azure Data Lake Storage [must have]4. Azure Data Factory - orchestration of pipelines [must have]5. Azure Data Engineering Platform [must have to...

  • Store Keeper and Data Entry Clerk

    3 months ago

    Coimbatore, India Coimbatore Compressors Engineering Company Pvt. Ltd. Full time

    **Company description** Coimbatore Compressor Engineering Company was established in 1988. We are an ISO 9001:2015 certified company focussed in the manufacture of reciprocating air compressors. With customers all over India, we are an approved supplier to Indian Railways and several of our compressor models are regularly used in Electric Locomotives, EMU...

  • Azure Data Engineer

    5 days ago

    Coimbatore, India 360 Technology Full time

    Job Title:Azure Data EngineerLocation:Bharteeya City, Bangalore (Hybrid)Experience:5+ Years (4+ years relevant in Azure Data Engineering)Key Responsibilities:Develop complex queries and stored procedures usingT-SQLwith a focus on performance tuningDesign, implement, and optimizeAzure-based data solutionsDevelop and manageend-to-end ETL pipelinesusingAzure...

  • Data Engineer: Data Platforms

    4 months ago

    Coimbatore, Tamil Nadu, India IBM Full time

    IntroductionIn this role, you'll work in one of IBM's Client Innovation Centers, where deep technical expertise is delivered to public and private sector clients globally. The center provides locally based skills and technical expertise for driving innovation and new technology adoption.Joining IBM Consulting entails building long-term relationships and...

  • Supply Quality Engineer

    2 months ago

    Coimbatore, India Yield Engineering Systems Full time

    YES (Yield Engineering Systems, Inc.) is a leading manufacturer of reliable, high-tech, cost-effective capital equipment that transforms materials and surfaces at the nanoscale. From startups to the Fortune 50, our customers rely on YES to help them unleash products that change lives – from cellphones and IoT devices,to AI and virtual reality, to...