Senior Cloud Data Engineer
2 weeks ago
Job Description :
As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions.
Your primary responsibilities will include :
Key Responsibilities :
- Cloud Data Engineering : Design, develop, and maintain data pipelines, ETL processes, and data workflows on Azure Synapse, leveraging Azure Data Factory and other relevant services.
- Python and PySpark : Utilize Python and PySpark for data processing and transformation tasks, ensuring data accuracy and performance.
- Azure DevOps : Implement best practices for CI/CD pipelines, infrastructure as code, and automation to ensure a seamless and efficient development and deployment process.
- Serverless Computing : Architect and build serverless data solutions using Azure Functions, AWS Lambda, or similar technologies for optimal resource utilization.
- Data Governance : Implement data governance and data quality standards to ensure data integrity and compliance with regulatory requirements.
- Performance Optimization : Continuously monitor and optimize data pipelines for scalability, performance, and cost efficiency.
- Collaboration : Collaborate with data scientists, data analysts, and other stakeholders to understand their data requirements and provide data engineering support.
- Documentation : Create and maintain technical documentation, including architecture diagrams, data flow diagrams, and standard operating procedures.
- Mentorship : Provide guidance and mentorship to junior team members, fostering their growth and development.
Qualifications :
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- 8-10 years of experience in data engineering and cloud solutions.
- Proficiency in Azure Synapse, Azure Data Factory, and other Azure services.
- Strong programming skills in Python and experience with PySpark.
- Experience with Foundry or similar data management platforms.
- Expertise in Azure DevOps practices and tools.
- Knowledge of serverless computing and microservices architecture.
- Strong problem-solving skills and the ability to work in a collaborative, fast-paced environment.
- Excellent communication and interpersonal skills.
- Azure certifications (e.g. Azure Data Engineer, Azure DevOps Engineer) are a plus.
-
Senior Data Engineer
3 weeks ago
Bengaluru, India Lorven Technologies Full timeJob Description: As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.- Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...
-
Senior Data Engineer
21 hours ago
Bengaluru, India [24]7.ai Full timeJob Role: Senior– Data EngineerJob Location: BangaloreWorking: HybridSummary of Essential Job Functions- Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.- Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform.-...
-
Senior Cloud Engineer
2 weeks ago
Bengaluru, India Avis Budget Group (ABG) Full timeRole: Senior EngineerJob Summary:The Technology Transformation team in Avis is a technology specialist team to roll out new capabilities into the cloud to support engineers, analysts, and business teams. This role does NOT require night shifts but need to have overlapping hours between IST and US east morning hours for proper hand holding with...
-
Senior Cloud Engineer
1 week ago
Bengaluru, India Avis Budget Group (ABG) Full timeRole: Senior Engineer Job Summary : The Technology Transformation team in Avis is a technology specialist team to roll out new capabilities into the cloud to support engineers, analysts, and business teams. This role does NOT require night shifts but need to have overlapping hours between IST and US east morning hours for proper hand holding with...
-
Senior Data Engineer
15 hours ago
Bengaluru, India [24]7.ai Full timeJob Role: Senior– Data EngineerJob Location: Bangalore Working: HybridSummary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...
-
Senior Data Engineer
2 days ago
Bengaluru, India [24]7.ai Full timeJob Role: Senior– Data Engineer Job Location: Bangalore Working: Hybrid Summary of Essential Job Functions Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow. Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...
-
Senior Data Engineer
2 days ago
Bengaluru, India [24]7.ai Full timeJob Role: Senior– Data EngineerJob Location: Bangalore Working: HybridSummary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...
-
Senior Cloud Data Engineer
4 weeks ago
Bengaluru, India CIEL HR Services Full timeDescription:Title: Senior Cloud Data EngineerLocation: BangaloreTop Skills:1. Python and Pyspark2. SQL ( must able to write complex sql)3. Working knowledge with primary AWS Services like Glue, Airflow, DMS, Cloudwatch, cloudformation.4. Database: Redshift, AuroraResponsibilities:• Design, implement, and support various database services of our Cloud...
-
Data Scientist
3 weeks ago
Bengaluru, India Cloud Raptor Full timeAtCloud Raptor , we specialise in providing scalable and efficient solutions to businesses acrossmany industries. Focused on cloud technologies and technical expertise, we help organisationsnavigate the ever-changing landscape of the digital era.With dedicated Centres of Excellence across the globe, we are enabled to delivercomprehensive, senior resourcing...
-
Senior Data Engineer
4 days ago
Bengaluru, India Valiance Solutions Full timeAbout Valiance:Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India.Job Overview:We are seeking a highly skilled and experienced Senior Databricks Engineer to join...
-
Senior Data Engineer
4 weeks ago
Bengaluru, India News Corp Full timeJob Description: Senior Data EngineerAbout the RoleWe are looking for aSenior Data Engineerwith experience in excellent analytical abilities inGCP BigQuery, ETL/BI, Python,Composer/Airflow,DataFusion, SQL,GCP Services- with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse.Skills & CompetenciesA...
-
Senior Data Engineer
6 days ago
Bengaluru, India Valiance Solutions Full timeAbout Valiance:Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India.Job Overview:We are seeking a highly skilled and experienced Senior Databricks Engineer to join...
-
Senior Data Engineer
1 month ago
Bengaluru, India News Corp Full timeJob Description : Senior Data Engineer About the Role We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, DataFusion, SQL , GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the larger data...
-
Senior Cloud Engineer
1 week ago
Bengaluru, Karnataka, India TIBCO Software India Pvt Ltd Full timeApply for Senior Cloud Engineer, Career Progress Consultants in Bengaluru/ Bangalore for Year of Experience on
-
Senior Engineer Google Cloud Monitoring
2 days ago
Bengaluru, India Ericsson Full timeDescription Join our Team About this opportunity We are looking for a Sr. Engineer-Cloud Monitoring with hands-on experience in Integration Monitoring ticketing tool, Deployment, configuration. What you will do • Work with cloud native application design and development using APIs, containers, Kubernetes, service mesh (Istio), preferably on...
-
Senior Data Engineer
3 weeks ago
Bengaluru, India ZoomInfo Full timeSenior Data EngineerPosition: Senior Data EngineerLocation: BangaloreExperience : 7-10 YearsAbout the Role:Join our Product Data Monitoring team as a Data Engineer, where you play a pivotal role in enhancing and architecting the strategy behind our data monitoring and quality assurance systems. In this dynamic position, you'll serve as both a developer and...
-
Senior Engineer Google Cloud Monitoring
4 days ago
Bengaluru, India Ericsson Full timeDescriptionJoin our TeamAbout this opportunityWe are looking for a Sr. Engineer-Cloud Monitoring with hands-on experience in Integration Monitoring ticketing tool, Deployment, configuration.What you will do• Work with cloud native application design and development using APIs, containers, Kubernetes, service mesh (Istio), preferably on Google Cloud...
-
Senior Data Engineer
6 days ago
Bengaluru, India Valiance Solutions Full timeAbout Valiance:Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India. Job Overview:We are seeking a highly skilled and experienced Senior Databricks Engineer to join...
-
Senior Engineer, Data
1 month ago
Bengaluru, India News Corp Full timeJob Description : Senior Engineer, Data One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve combining all of News Corp’s data across categories, countries and organizations into a singular view of a customer enabling engagement, measurement and...
-
Cloud Engineer
2 weeks ago
Bengaluru, India Avis Budget Group (ABG) Full timeRole: Senior EngineerJob Summary:The Technology Transformation team in Avis is a technology specialist team to roll out new capabilities into the cloud to support engineers, analysts, and business teams. This role does NOT require night shifts but need to have overlapping hours between IST and US east morning hours for proper hand holding with...