(High Salary) Cloud Data Engineer

3 weeks ago

Bengaluru, India Brighttier Inc Full time

Job Description Key Responsibilities: Design and Development: - Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.). - Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP). - Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse. - Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others. - Develop and optimize data processing jobs using Spark Scala. Data Integration and Management: - Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake. - Ensure data quality and integrity through rigorous testing and validation. - Perform data extraction from SAP or ERP systems when necessary. Performance Optimization: - Monitor and optimize the performance of data pipelines and ETL processes. - Implement best practices for data management, including data governance, security, and compliance. Collaboration and Communication: - Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. - Collaborate with cross-functional teams to design and implement data solutions that meet business needs. Documentation and Maintenance: - Document technical solutions, processes, and workflows. - Maintain and troubleshoot existing ETL pipelines and data integrations. Education: - Bachelor s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus. Experience: - 7+ years of experience as a Data Engineer or in a similar role. - Proven experience with cloud platforms: AWS, Azure, and GCP. - Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc. - Experience with other ETL tools like Informatica, SAP Data Intelligence, etc. - Experience in building and managing data lakes and data warehouses. - Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse. - Experience with data extraction from SAP or ERP systems is a plus. - Strong experience with Spark and Scala for data processing. Skills: - Strong programming skills in Python, Java, or Scala. - Proficient in SQL and query optimization techniques. - Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts. - Knowledge of data governance, security, and compliance best practices. - Excellent problem-solving and analytical skills. - Strong communication and collaboration skills. Preferred Qualifications: - Experience with other data tools and technologies such as Apache Spark, or Hadoop. - Certifications in cloud platforms (AWS Certified Data Analytics - Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate). - Experience with CI/CD pipelines and DevOps practices for data engineering - Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.

  • ▷ High Salary! Oracle cloud PLM Consultant

    4 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Oracle cloud PLM Consultant to join our team in Bangalore, Karntaka (IN-KA), India (IN). About the role: Technical...

  • (High Salary) Data Engineer

    4 weeks ago

    Bengaluru, India Synechron Full time

    Good-day,We have immediate opportunity for Data Engineer (Python, Spark/Scala).Job Role: Data Engineer (Python, Spark/Scala)Job Location: BangaloreExperience-5 to 10 yearsNotice Period: Immediate joiner only.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity...

  • Cloud Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Blue Cloud Softech Solutions Full time ₹ 25,00,000 - ₹ 30,00,000 per year

    Title-Cloud data Engineermode:RemoteJob Description:Primary Responsibilities· Analyze and understand existing data warehouse implementations to support migration and consolidation efforts.· Reverse-engineer legacy stored procedures (PL/SQL, SQL) and translate business logic into scalable Spark SQL code within Databricks notebooks.· Design and develop data...

  • High Salary: Data Engineer

    3 weeks ago

    Bengaluru, India Networth Corp Full time

    Responsibilities: - Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services - End to end development lifecycle of complex large-scale and multi-user applications - Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios - Big Data ETL...

  • (High Salary) Azure Data Engineer

    3 weeks ago

    Bengaluru, India Onactive Consulting Full time

    Job Description Key Responsibilities: - Design, develop, and maintain data solutions on Azure cloud platforms. - Work extensively with data lakes, data warehouses, and Snowflake (preferred). - Assemble and integrate large, complex datasets meeting functional and non-functional business requirements. - Model and orchestrate complex finance-related data...

  • Cloud Data Engineer

    4 days ago

    Bengaluru, India Blue Cloud Softech Solutions Limited Full time

    Job Overview – Cloud Data Engineer we strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS...

  • Cloud Data Engineer

    6 days ago

    Bengaluru, India Blue Cloud Softech Solutions Limited Full time

    Job Overview – Cloud Data Engineerwe strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS...

  • Cloud Data Engineer

    6 days ago

    Bengaluru, India Blue Cloud Softech Solutions Limited Full time

    Job Overview – Cloud Data Engineerwe strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS...

  • Cloud Data Engineer

    5 days ago

    Bengaluru, India Blue Cloud Softech Solutions Limited Full time

    Job Overview – Cloud Data Engineerwe strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS...

  • Cloud data engineer

    4 days ago

    Bengaluru, India Blue Cloud Softech Solutions Limited Full time

    Job Overview – Cloud Data Engineerwe strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS...