AWS Data Engineer
2 months ago
Mandatory Skills : AWS, Python, SQL, spark, Airflow, Snowflake
Responsibilities :
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
-
AWS Data Engineer
2 days ago
chennai, India RELX Full timeAbout the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...
-
AWS Data Engineer
2 days ago
Chennai, India RELX India (Pvt) Ltd L&P div Company Full timeAbout the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...
-
Data Engineer
2 months ago
chennai, India Notus Full timeAWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...
-
AWS Data Engineer
3 weeks ago
Chennai, India LexisNexis Full timeSoftware Engineer IIIDo you enjoy designing analytic solutions at an enterprise scale for global customers?Do you have experience in working on complex problems?About our TeamOur product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data from various...
-
AWS Data Engineer
3 weeks ago
chennai, India LexisNexis Full timeSoftware Engineer III Do you enjoy designing analytic solutions at an enterprise scale for global customers? Do you have experience in working on complex problems? About our Team Our product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data...
-
AWS Data Engineer
3 weeks ago
Chennai, India LexisNexis Full timeSoftware Engineer IIIDo you enjoy designing analytic solutions at an enterprise scale for global customers?Do you have experience in working on complex problems?About our TeamOur product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data from various...
-
Data Engineer Python, AWS
1 week ago
chennai, India Virtusa Full timeData Engineer Python, AWS - CREQ188952 Description Skillset required for this project : Python, AWS, Starbust, Neo4jRoles and Responsibilities : Data Engineer Role1. Data Pipeline Development: Design, build, and maintain scalable data pipelines in AWS Glue using Python code language to ingest, transform, and load data from sources (AWS S3 bucket) into data...
-
Data Engineer
4 weeks ago
Bangalore/Chennai, India Notus Full timeAWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...
-
Data Engineer
1 month ago
Bangalore/Chennai, Tamil Nadu, India Notus Full timeAWS Data EngineerJob Title: AWS Data EngineerLocation: Bangalore / ChennaiExperience: 8+ YearsJob Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services, Kafka,...
-
AWS Data Engineer
24 hours ago
Chennai, India HTC Global Services Full timeAWS Data EngineerExperience: 5+ yearsLocation: Chennai Notice Period: Immediate to 30 daysJob Description: Bachelors or master’s in software engineering, Computer Science, or other relevant disciplinesStrong Knowledge in SQL and Python v3.x LanguageCan analyse new source data, model entities, and write complex SQL.Minimum 5 years of Overall Development...
-
AWS Data Engineer
2 days ago
Chennai, India HTC Global Services Full timeAWS Data EngineerExperience: 5+ yearsLocation: Chennai Notice Period: Immediate to 30 daysJob Description: Bachelors or master’s in software engineering, Computer Science, or other relevant disciplinesStrong Knowledge in SQL and Python v3.x LanguageCan analyse new source data, model entities, and write complex SQL.Minimum 5 years of Overall Development...
-
AWS Data Engineer
1 month ago
Chennai, India CliqHR Full timeJob Description :- Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification- Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns- Work closely with DevOps engineer to...
-
AWS Data Engineer
1 month ago
Chennai, India CliqHR Full timeJob Description : - Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification- Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns- Work closely with DevOps engineer to...
-
AWS Data Engineer
1 month ago
Chennai, Tamil Nadu, India CliqHR Full timeJob Description :- Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification- Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns- Work closely with DevOps engineer to...
-
AWS Data Engineer
5 days ago
Chennai, India CliqHR Full timeJob Description : - AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...
-
AWS Data Engineer
6 days ago
chennai, India CliqHR Full timeJob Description : - AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).- Proficient...
-
AWS Data Engineer
6 days ago
Chennai, India CliqHR Full timeJob Description :- AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...
-
AWS Data Engineer
3 hours ago
Chennai, Tamil Nadu, India CliqHR Full timeJob Description :- AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...
-
Senior Data Engineer( AWS Redshift)
2 months ago
chennai, India Anicalls (Pty) Ltd Full timeCandidate should have:Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborateStrong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud settingUnderstanding of ELK stack is a plus for logging and reporting purposesExperience...
-
Data Engineer(Pyspark, AWS and SQL)
2 months ago
chennai, India Virtusa Full timeData Engineer(Pyspark, AWS and SQL) - CREQ186019 Description 4-6 years work experience in Software Engineering especially in professional software product development.Expertise in AWS and python coding.Flexible to learn and work for any programming language based on need.Proficient in pipeline for file loading from multiple different sources having different...