Senior Cloud Data Engineer

3 weeks ago

Bangalore, Karnataka, India Info Origin Inc Full time

Job Description :

As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions.

Your primary responsibilities will include :

Key Responsibilities :

- Cloud Data Engineering : Design, develop, and maintain data pipelines, ETL processes, and data workflows on Azure Synapse, leveraging Azure Data Factory and other relevant services.

- Python and PySpark : Utilize Python and PySpark for data processing and transformation tasks, ensuring data accuracy and performance.

- Azure DevOps : Implement best practices for CI/CD pipelines, infrastructure as code, and automation to ensure a seamless and efficient development and deployment process.

- Serverless Computing : Architect and build serverless data solutions using Azure Functions, AWS Lambda, or similar technologies for optimal resource utilization.

- Data Governance : Implement data governance and data quality standards to ensure data integrity and compliance with regulatory requirements.

- Performance Optimization : Continuously monitor and optimize data pipelines for scalability, performance, and cost efficiency.

- Collaboration : Collaborate with data scientists, data analysts, and other stakeholders to understand their data requirements and provide data engineering support.

- Documentation : Create and maintain technical documentation, including architecture diagrams, data flow diagrams, and standard operating procedures.

- Mentorship : Provide guidance and mentorship to junior team members, fostering their growth and development.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.

- 8-10 years of experience in data engineering and cloud solutions.

- Proficiency in Azure Synapse, Azure Data Factory, and other Azure services.

- Strong programming skills in Python and experience with PySpark.

- Experience with Foundry or similar data management platforms.

- Expertise in Azure DevOps practices and tools.

- Knowledge of serverless computing and microservices architecture.

- Strong problem-solving skills and the ability to work in a collaborative, fast-paced environment.

- Excellent communication and interpersonal skills.

- Azure certifications (e.g. Azure Data Engineer, Azure DevOps Engineer) are a plus.

(ref:hirist.tech)

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Director

    2 months ago

    Bangalore, Karnataka, India Recruise India Consulting Full time

    Role : Senior Director - Data Engineering & AnalyticsResponsibilities :- Provide strategic leadership and vision for the data engineering and analytics function, aligning it with the overall business goals.- Lead and manage a diverse team of data engineers, data architects, data scientists, and cloud operations specialists.- Foster a culture of innovation,...

  • Senior Director

    3 weeks ago

    Bangalore, Karnataka, India Recruise India Consulting Full time

    Role : Senior Director - Data Engineering & AnalyticsResponsibilities :- Provide strategic leadership and vision for the data engineering and analytics function, aligning it with the overall business goals.- Lead and manage a diverse team of data engineers, data architects, data scientists, and cloud operations specialists.- Foster a culture of innovation,...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Grizmo Labs Full time

    Responsibilities :- Develop, construct, test, and maintain architectures such as large-scale processing systems, and other infrastructure using tools and technologies such as Hadoop, Spark, and Kafka.- Assemble large, complex data sets that meet functional / non-functional business requirements, utilizing SQL, NoSQL, and cloud-based data warehousing...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Grizmo Labs Full time

    Responsibilities :- Develop, construct, test, and maintain architectures such as large-scale processing systems, and other infrastructure using tools and technologies such as Hadoop, Spark, and Kafka.- Assemble large, complex data sets that meet functional / non-functional business requirements, utilizing SQL, NoSQL, and cloud-based data warehousing...

  • Senior Data Engineer

    7 days ago

    Bangalore, Karnataka, India Infometry Full time

    We are looking for a Senior Data Engineer for Bangalore(Remote) location, who can join us immediately.Role : Senior Data EngineerLocation : Bangalore(Remote)Experience : 5+ yearsJob Description :- Minimum of 3+ years' Experience in Google Big Query and Google Cloud Platform.- Design and develop the ETL framework using Big Query.- Expertise in Big Query...

  • Senior Staff Information Security Cloud Engineer

    2 months ago

    Bangalore, Karnataka, India HeadPro Consulting LLP Full time

    Job Title : Senior Staff Info security cloud engineerLocation : BangaloreExp : 12 - 15 YearsBudget : 40 - 60LPAMandatory skills :1. Need someone who have good experience in implementing & supporting information security enterprise level cloud based tools. 2. Candidate should have worked with cloud computing infrastructure architecture.3. Candidate should...

  • Senior Staff Information Security Cloud Engineer

    3 weeks ago

    Bangalore, Karnataka, India HeadPro Consulting LLP Full time

    Job Title : Senior Staff Info security cloud engineerLocation : BangaloreExp : 12 - 15 YearsBudget : 40 - 60LPAMandatory skills :1. Need someone who have good experience in implementing & supporting information security enterprise level cloud based tools. 2. Candidate should have worked with cloud computing infrastructure architecture.3. Candidate should...

  • Cloud Infrastructure Engineer

    1 month ago

    Bangalore, Karnataka, India Top Talent Technologies Pvt Ltd Full time

    Job Description :- Design, provision, and maintain data infrastructure using cloud-native services (e.g., Amazon MSK, Apache NiFi).- Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration.- Optimize data infrastructure for performance, scalability, and cost-effectiveness.- Monitor and...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Bangalore, Karnataka, India Top Talent Technologies Pvt Ltd Full time

    Job Description :- Design, provision, and maintain data infrastructure using cloud-native services (e.g., Amazon MSK, Apache NiFi).- Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration.- Optimize data infrastructure for performance, scalability, and cost-effectiveness.- Monitor and...

  • Senior Software Engineer

    7 days ago

    Bangalore, Karnataka, India Hireginie Talent Cloud Pvt Ltd Full time

    Senior Software Engineer : JavaWork location : Koramangala, :- Lead and mentor a team of Java developers, providing guidance and support throughout the software development lifecycle- Collaborate with cross-functional teams to define requirements, design architecture, and develop solutions that meet business objectives- Drive the adoption of best practices...

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India MIQ Digital Full time

    Role : Sr. Data EngineerLocation : BengaluruWhat you'll do :We're MiQ, a global programmatic media partner for marketers and agencies. Our people are at the heart of everything we do, so you will be too. No matter the role or the location, we're all united in the vision to lead the programmatic industry and make it better.As a Sr. Data Engineer...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India MIQ Digital Full time

    Role : Sr. Data EngineerLocation : BengaluruWhat you'll do :We're MiQ, a global programmatic media partner for marketers and agencies. Our people are at the heart of everything we do, so you will be too. No matter the role or the location, we're all united in the vision to lead the programmatic industry and make it better.As a Sr. Data Engineer...

  • ACL Digital

    2 months ago

    Bangalore/Hyderabad, Karnataka, India ACL Digital Full time

    Job Description :- We are seeking a highly skilled Senior Data Engineer with 3-12 years of experience to join our dynamic team.- As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure to support our analytics and business intelligence initiatives.- You will leverage your expertise in data...

  • Senior AWS Engineer

    2 months ago

    Bangalore, Karnataka, India Info Origin Inc Full time

    About the Role :- We are seeking a highly experienced and certified Senior AWS Engineer to join our team and play a pivotal role in designing, developing, and managing our cloud infrastructure on Amazon Web Services (AWS).- You will leverage your in-depth knowledge of AWS services and best practices to build secure, scalable, and cost-effective solutions...

  • Senior AWS Engineer

    3 weeks ago

    Bangalore, Karnataka, India Info Origin Inc Full time

    About the Role :- We are seeking a highly experienced and certified Senior AWS Engineer to join our team and play a pivotal role in designing, developing, and managing our cloud infrastructure on Amazon Web Services (AWS).- You will leverage your in-depth knowledge of AWS services and best practices to build secure, scalable, and cost-effective solutions...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Intelli Swift Full time

    Data Engineer - Bangalore (Hybrid) Position : Data Engineer Experience : 7-12 Years Notice Period : less than 15-20 days Mode of Hiring : Permanent Work Location : Bangalore (Hybrid Must Have skills : Data Engineer, GCP, Big Query, Python, SQL, big data. Job Requirement Must Have skills : 1. Designing and implementing data pipelines and infrastructure 2....