Senior Cloud Data Engineer
4 weeks ago
Job Overview:
- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.
- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.
Location: India (Most Preferrable - Bangalore)
Experience Level : 5-12 years
Budget : 28 lpa
Role Overview :
- We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team.
- As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS.
- Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our data-driven projects.
Primary Skills :
- AWS PySpark Python programming.
- He has to do coding in day to day activities and also expected to review the code developed by the team.
- Must be aware of AWS services like Glue, redshift, S3, Airflow etc.
- Candidate is expected to manage stakeholder management along with mentoring the offshore team.
- Candidate must have technical expertise to advise effective solutions to the client on AWS Pipeline Development:
- Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.
- Optimize data pipelines for performance, scalability, and reliability.
- Implement data aggregation, consolidation, and enrichment.
Workflow Automation :
- Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.
- Schedule, monitor, and manage data processing tasks efficiently.
Database Management :
- Leverage your strong SQL skills to create and optimize database queries.
Cloud Infrastructure :
- Collaborate with architecture teams to design and implement AWS cloud infrastructure.
- Ensure security, scalability, and cost-effectiveness of cloud resources.
Support Project Processes :
- Work closely with cross-functional teams to understand project requirements and deliverables.
- Provide technical support during project execution and troubleshoot issues as needed.
Optional Python Skills :
- Familiarity with Python for scripting and automation tasks is a plus.
Qualifications :
- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
- AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are advantageous.
- Strong problem-solving skills and ability to work independently.
- Excellent communication and collaboration skills.
Benefits :
- Competitive salary and benefits package.
- Opportunity to work on cutting-edge cloud technologies.
- Career growth and professional development.
-
Senior Cloud Data Engineer
4 weeks ago
Bangalore, Karnataka, India Info Origin Inc Full timeJob Description :As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions. Your primary responsibilities will include :Key Responsibilities :- Cloud Data Engineering...
-
Senior Data Engineer
4 weeks ago
Bangalore, Karnataka, India Muoro Full timeJob Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...
-
Aptus Data Labs
4 weeks ago
Bangalore, Karnataka, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...
-
Senior Data Engineer
4 weeks ago
Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...
-
Senior Director
1 week ago
Bangalore, Karnataka, India Recruise India Consulting Full timeRole : Senior Director - Data Engineering & AnalyticsResponsibilities :- Provide strategic leadership and vision for the data engineering and analytics function, aligning it with the overall business goals.- Lead and manage a diverse team of data engineers, data architects, data scientists, and cloud operations specialists.- Foster a culture of innovation,...
-
Senior Data Engineer
4 weeks ago
Bangalore, Karnataka, India TalentPulse Consultant Full timeJob Description:We are looking for a talented Senior Data Engineer to join our team in Bangalore. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. This position offers a hybrid work model, allowing a combination of remote and onsite...
-
Data Engineer
4 weeks ago
Bangalore, Karnataka, India Magna Hire Full timeResponsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...
-
Data Analyst
4 weeks ago
Bangalore, Karnataka, India CLOUD RAPTOR INDIA DIGITAL SERVICES Full timeData Analyst About the job:- At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across many industries.- Focused on cloud technologies and technical expertise, we help organisations navigate the ever-changing landscape of the digital era.- With dedicated Centres of Excellence across the globe, we are enabled to deliver...
-
Senior Cloud Database Engineer
4 weeks ago
Bangalore, Karnataka, India Spigot Software Pvt Ltd Full timeRole - Senior Cloud Database Engineer (OCI) Job Description :We are looking to add an energetic and self-motivated Senior Cloud Database Engineer to our high performing global team of Database Engineering Experts. This role involves architecting, implementing and supporting technological solutions with Oracle 19c on Cloud platform for revenue generating...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India Grizmo Labs Full timeResponsibilities :- Develop, construct, test, and maintain architectures such as large-scale processing systems, and other infrastructure using tools and technologies such as Hadoop, Spark, and Kafka.- Assemble large, complex data sets that meet functional / non-functional business requirements, utilizing SQL, NoSQL, and cloud-based data warehousing...
-
Senior Staff Information Security Cloud Engineer
3 weeks ago
Bangalore, Karnataka, India HeadPro Consulting LLP Full timeJob Title : Senior Staff Info security cloud engineerLocation : BangaloreExp : 12 - 15 YearsBudget : 40 - 60LPAMandatory skills :1. Need someone who have good experience in implementing & supporting information security enterprise level cloud based tools. 2. Candidate should have worked with cloud computing infrastructure architecture.3. Candidate should...
-
Cloud Infrastructure Engineer
4 days ago
Bangalore, Karnataka, India Top Talent Technologies Pvt Ltd Full timeJob Description :- Design, provision, and maintain data infrastructure using cloud-native services (e.g., Amazon MSK, Apache NiFi).- Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration.- Optimize data infrastructure for performance, scalability, and cost-effectiveness.- Monitor and...
-
ACL Digital
4 weeks ago
Bangalore/Hyderabad, Karnataka, India ACL Digital Full timeJob Description :- We are seeking a highly skilled Senior Data Engineer with 3-12 years of experience to join our dynamic team.- As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure to support our analytics and business intelligence initiatives.- You will leverage your expertise in data...
-
Senior Director
4 weeks ago
Bangalore, Karnataka, India Recrud Full timeJob Description : Recrud is excited to partner with a leading organization in the biopharmaceutical domain to find an exceptional candidate for the role of Senior Director - Data Engineering & Analytics, focusing on commercial technology. This opportunity is based in Bengaluru and offers the chance to be at the forefront of driving technological innovation...
-
Data Engineer
4 weeks ago
Bangalore, Karnataka, India Intelli Swift Full timeData Engineer - Bangalore (Hybrid) Position : Data Engineer Experience : 7-12 Years Notice Period : less than 15-20 days Mode of Hiring : Permanent Work Location : Bangalore (Hybrid Must Have skills : Data Engineer, GCP, Big Query, Python, SQL, big data. Job Requirement Must Have skills : 1. Designing and implementing data pipelines and infrastructure 2....
-
Senior AWS Engineer
2 weeks ago
Bangalore, Karnataka, India Info Origin Inc Full timeAbout the Role :- We are seeking a highly experienced and certified Senior AWS Engineer to join our team and play a pivotal role in designing, developing, and managing our cloud infrastructure on Amazon Web Services (AWS).- You will leverage your in-depth knowledge of AWS services and best practices to build secure, scalable, and cost-effective solutions...
-
Cloud Security Engineer
3 weeks ago
Bangalore, Karnataka, India RapidBraiins Full timeExperience Level:10-15 yearsNotice period: 0-30 DaysLocation: BengaluruPosition Type: Full-TimeJob DescriptionAs a Senior Cloud Security Engineer, you will play a crucial role in ensuring the security and compliance of our Google Cloud Platform (GCP) environments. You will be responsible for designing and implementing robust security solutions, conducting...
-
Senior Data Engineer
2 weeks ago
Bangalore, Karnataka, India MIQ Digital Full timeRole : Sr. Data EngineerLocation : BengaluruWhat you'll do :We're MiQ, a global programmatic media partner for marketers and agencies. Our people are at the heart of everything we do, so you will be too. No matter the role or the location, we're all united in the vision to lead the programmatic industry and make it better.As a Sr. Data Engineer...
-
Senior DevOps Engineer
4 weeks ago
Bangalore, Karnataka, India CLOUD RAPTOR INDIA DIGITAL SERVICES Full timeSenior DevOps EngineerAbout us:- At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across many industries.- Focused on cloud technologies and technical expertise, we help organisations navigate the ever-changing landscape of the digital era.- With dedicated Centres of Excellence across the globe, we are enabled to...
-
Senior AWS DevOps Engineer
4 weeks ago
Bangalore, Karnataka, India CLOUD RAPTOR INDIA DIGITAL SERVICES Full timeAbout the job :- At Cloud Raptor, we specialize in providing scalable and efficient solutions to businesses across many industries.- Focused on cloud technologies and technical expertise, we help organizations navigate the ever-changing landscape of the digital era.- With dedicated Centers of Excellence across the globe, we are enabled to deliver...