Cloud Data Engineer

2 days ago

Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 5,00,000 - ₹ 8,00,000
Job Description

As a key member of our data team, you will play a critical role in building and maintaining our cloud Data Lake platform using Databricks. This involves contributing to all stages of the data lifecycle, from ingestion and modeling to profiling, quality, transformation, movement, and curation.

  • Design and implement resilient data systems that can withstand disruptions and failures.
  • Ensure high uptime for all data services by implementing efficient monitoring and maintenance procedures.
  • Bring modern technologies and practices into the system to improve reliability and support rapid scaling of business data needs.
  • Scale up our data infrastructure to meet business demands by leveraging advanced architecture and engineering techniques.
  • Develop production-ready data pipeline patterns using industry-leading tools and frameworks.
  • Provide subject matter expertise and hands-on delivery of data acquisition, curation, and consumption pipelines on Azure.
  • Maintain current and emerging state-of-the-art computer and cloud-based solutions and technologies.
  • Build effective relationships with internal stakeholders to drive collaboration and success.
  • Familiarity with leading-edge technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog, etc.
  • Hands-on experience implementing analytics solutions leveraging Python, Spark SQL, Databricks Lakehouse Architecture, Kubernetes, Docker.
  • Perform other duties as assigned to ensure overall team success.

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Management Information Systems (MIS), Data Science or related field. Relevant years of experience may be substituted for the degree requirement.
  • Up to 8 years of experience in software engineering.
  • Experience with large and complex data projects is preferred.
  • Experience with large-scale data warehousing architecture and data modeling is preferred.
  • Working knowledge of Cloud-based architecture such as Azure Cloud is preferred.
  • Experience working with big data technologies e.g. Snowflake, Redshift, Synapse, Postgres, Airflow, Kafka, Spark, DBT is preferred.
  • Experience implementing pub/sub and streaming use cases is preferred.
  • Experience in design reviews is preferred.
  • Experience influencing a team's technical and business strategy by making insightful contributions to team priorities and approaches is preferred.
  • Working knowledge of relational databases is preferred.
  • Expertise in SQL and high-level languages such as Python, Java or Scala is preferred.
  • Able to analyze large data sets to identify gaps and inconsistencies in ETL pipeline and provide solutions for pipeline reliability and data quality.
  • Experience in infrastructure as code / CICD development environment is preferred.
  • Proven ability to build, manage and foster a team-oriented environment.
  • Excellent communication (written and oral) and interpersonal skills.
  • Excellent organizational, multi-tasking, and time-management skills.

  • Cloud Engineer

    4 days ago

    Mumbai, Maharashtra, India Cloud 9 Infosystems Full time

    Work Location : Ghatkopar (Onsite).Working days : 5 days a week, Work from Home on- 1st and 3rd Saturday if needed, not necessary.Cloud Engineer Azure and M365. Job Description :- Minimum 2 to 3 Years of experience in Azure Infrastructure and AWS will be an added advantage.- Extensive Experience in IaaS vs. PaaS vs. SaaS Services.- Strong knowledge of MS...

  • Cloud Engineer

    1 day ago

    Mumbai, Maharashtra, India Cloud 9 Infosystems, Inc. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Urgent Opening for Cloud Engineer - Azure and M365Job Profile -·   Minimum 2 to 3 Years of experience in Azure Infrastructure and AWS will be an added advantage.· Extensive Experience in IaaS vs. PaaS vs. SaaS Services.· Strong knowledge of MS Azure products and Cloud services.· Good experience on-premises to Azure migration.· Strong Knowledge of Data...

  • Cloud Data Engineer

    2 days ago

    Mumbai, Maharashtra, India beBeeCloudDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About our Data Engineering TeamAt Teamware Solutions, we are dedicated to delivering cutting-edge data engineering solutions.The Role: Cloud Data EngineerYou will play a crucial role in designing and implementing cloud-based data engineering solutions. We require someone with strong expertise in architecting and delivering highly scalable, distributed,...

  • Cloud Data Engineer

    1 week ago

    Mumbai, Maharashtra, India beBeeCloudDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Job Title: Cloud Data EngineerWe are seeking a skilled Cloud Data Engineer to join our team. The ideal candidate will have experience with cloud-based data solutions, particularly Google Cloud Platform (GCP), and possess strong knowledge of ETL development, BigQuery, Composer, and Dataform.The successful candidate will design and build robust and scalable...

  • Cloud Data Engineer

    4 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Cloud Data Engineer PositionWe are seeking a skilled cloud data engineer to design and implement data solutions that leverage cloud technologies and big data processing frameworks. The ideal candidate will have a strong background in data engineering and will be responsible for developing and maintaining data pipelines using AWS services, Pyspark, and...

  • Chief Cloud Data Engineer

    2 days ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 22,00,000

    Cloud Data Engineering LeaderWe are seeking a highly skilled and experienced Cloud Data Engineering Lead to manage and lead the migration of an on-premises Enterprise Data Warehouse (SQL Server) to a modern cloud-based data platform utilizing Azure Cloud data tools and Snowflake.This platform will enable offshore resources to build and develop Reporting,...

  • Cloud Data Engineer Position

    2 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data EngineerThis is a long-term contract role that requires the candidate to work remotely as a cloud data engineer. The ideal candidate will have 5-7 years of experience in data engineering with core Google Cloud experience of 3-4 years.Key Responsibilities:Develop, construct, test and maintain large volume data acquisition pipelines for...

  • Cloud Data Engineer Specialist

    2 days ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:GCP Data EngineerJob Description:We are seeking a skilled professional to fill the role of GCP Data Engineer. This is an exciting opportunity for those who possess expertise in cloud-based data engineering and want to contribute to innovative projects.The ideal candidate will have experience working with Google Cloud Platform (GCP), BigQuery, SQL,...

  • Cloud Data Engineer

    6 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    **Job Overview**We are seeking a skilled professional to join our data engineering team. The ideal candidate will have strong experience in Google Cloud Platform (GCP), ETL development, and hands-on expertise in Big Query, Composer, and Dataform.The successful applicant will be responsible for designing and building robust and scalable ETL workflows using...

  • Leading Cloud Data Engineer

    4 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 30,00,000

    Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and maintaining cloud-based data structures such as data marts, data warehouses, and data pipelines.Responsibilities:Design, build, test, and maintain cloud-based data structures.Develop ETL processes for...