Senior Cloud Data Engineer

2 months ago


bangalore, India Info Origin Inc Full time

Job Description :

As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions.

Your primary responsibilities will include :

Key Responsibilities :

- Cloud Data Engineering : Design, develop, and maintain data pipelines, ETL processes, and data workflows on Azure Synapse, leveraging Azure Data Factory and other relevant services.

- Python and PySpark : Utilize Python and PySpark for data processing and transformation tasks, ensuring data accuracy and performance.

- Azure DevOps : Implement best practices for CI/CD pipelines, infrastructure as code, and automation to ensure a seamless and efficient development and deployment process.

- Serverless Computing : Architect and build serverless data solutions using Azure Functions, AWS Lambda, or similar technologies for optimal resource utilization.

- Data Governance : Implement data governance and data quality standards to ensure data integrity and compliance with regulatory requirements.

- Performance Optimization : Continuously monitor and optimize data pipelines for scalability, performance, and cost efficiency.

- Collaboration : Collaborate with data scientists, data analysts, and other stakeholders to understand their data requirements and provide data engineering support.

- Documentation : Create and maintain technical documentation, including architecture diagrams, data flow diagrams, and standard operating procedures.

- Mentorship : Provide guidance and mentorship to junior team members, fostering their growth and development.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.

- 8-10 years of experience in data engineering and cloud solutions.

- Proficiency in Azure Synapse, Azure Data Factory, and other Azure services.

- Strong programming skills in Python and experience with PySpark.

- Experience with Foundry or similar data management platforms.

- Expertise in Azure DevOps practices and tools.

- Knowledge of serverless computing and microservices architecture.

- Strong problem-solving skills and the ability to work in a collaborative, fast-paced environment.

- Excellent communication and interpersonal skills.

- Azure certifications (e.g. Azure Data Engineer, Azure DevOps Engineer) are a plus.

(ref:hirist.tech)
  • Data Engineer

    6 days ago


    Bangalore, India CLOUD RAPTOR INDIA DIGITAL SERVICES Full time

    About the job:About us :- At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across many industries.- Focused on cloud technologies and technical expertise, we help organisations navigate the ever-changing landscape of the digital era.- With dedicated Centres of Excellence across the globe, we are enabled to deliver...


  • bangalore, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services,  Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to...


  • bangalore, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.


  • bangalore, India CIEL HR Services Full time

    Description: Title: Senior Cloud Data Engineer Location: Bangalore Top Skills: 1. Python and Pyspark 2. SQL ( must able to write complex sql) 3. Working knowledge with primary AWS Services like Glue, Airflow, DMS, Cloudwatch, cloudformation. 4. Database: Redshift, Aurora Responsibilities: • Design, implement, and support various database...

  • Senior Data Engineer

    2 weeks ago


    bangalore, India [24]7.ai Full time

    Job Role: Senior– Data EngineerJob Location: BangaloreWorking: HybridSummary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...


  • Bangalore Rural, India CIEL HR Services Full time

    Description: Title: Senior Cloud Data Engineer Location: Bangalore Top Skills: 1. Python and Pyspark 2. SQL ( must able to write complex sql) 3. Working knowledge with primary AWS Services like Glue, Airflow, DMS, Cloudwatch, cloudformation. 4. Database: Redshift, Aurora Responsibilities: • Design, implement, and support various database services of our...


  • Bangalore, India Info Origin Inc Full time

    Job Description :As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions. Your primary responsibilities will include :Key Responsibilities :- Cloud Data Engineering...


  • Bangalore, Karnataka, India Info Origin Inc Full time

    Job Description :As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions. Your primary responsibilities will include :Key Responsibilities :- Cloud Data Engineering...


  • bangalore, India Cloud Software Group Full time

    About This Team: Citrix-- the recognized leader in VDI, Desktop-as-a-Service, and application delivery solutions -- empowers enterprises of all sizes and industries to enable secure hybrid and remote working, from anywhere, using any device. Our Web UI platform delivers high-performance user experience regardless whether customers require cloud,...

  • Senior Data Engineer

    2 weeks ago


    Bangalore City, India 247. ai Full time

    Job Role: Senior– Data EngineerJob Location: Bangalore Working: HybridSummary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...


  • bangalore, India First Abu Dhabi Bank Full time

    Job Description Job Purpose  Role is required to support the transformation programme which aims at modernizing the data platforms estate for the bank. Traditional on-premises data warehouse and data lake should be transformed to meet the scalability, agility and modern capabilities needs as the bank embarks on the journey to implement the...


  • bangalore, India NTT DATA Full time

    Job Description Req ID:  272900  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....


  • bangalore, India NTT DATA Full time

    Job Description Req ID:  272900  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....

  • Senior Data Engineer

    1 month ago


    Bangalore,Anywhere in India,Multiple Locations Lorven Technologies Full time

    Job Description: As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.- Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...

  • Senior Data Engineer

    1 month ago


    Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full time

    Job Description: As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.- Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...


  • bangalore, India NTT DATA Services Full time

    Req ID:  272900  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Note- The preference...

  • Cloud Data Engineer

    1 week ago


    Bengaluru/ Bangalore, India timesjobs Full time

    JOB DETAILS1. You will be hands-on with the operational work relating to Datastax Cassandra, Aerospike, Couchbase, and Apache Solr, as well as custom infrastructure, probably using Ansible to help drive your work2. The work involves things like: redeploying data layer nodes to take advantage of security updates (without taking a downtime); dealing with node...


  • bangalore, India Ericsson Full time

    Description Join our Team About this opportunity We are looking for a Sr. Engineer-Cloud Monitoring with hands-on experience in Integration Monitoring ticketing tool, Deployment, configuration.What you will do • Work with cloud native application design and development using APIs, containers, Kubernetes, service mesh (Istio),...


  • bangalore, India Cloud Software Group Full time

    Do you thrive in a startup vibe? Were you built for a small, nimble and dynamic team that’s ready to win? If you answered yes, we want to talk to you! We are now going back to our roots as a standalone business unit to focus on our SaaS business—an area where we see growth potential. This business unit is unique, and we certainly aren’t afraid to stand...


  • bangalore, India Cloud Software Group Full time

    About This Team: ZTNA clients team takes care of the client projects for all platforms as part of Citrix Gateway product. It is widely used by various enterprise customers for securely accessing their enterprise resources remotely. It has ~10+ million monthly active users. Team is self-motivated, and owns the product with full sense of responsibility...