AWS Data Engineer
1 month ago
We are seeking a full-time AWS Data Engineer to join our team in Mumbai / Bangalore.
Company Description
TopN Analytics is an analytics services provider that helps companies achieve their goals through data-driven decision-making. We specialize in Big Data Analytics, Advanced Business Analytics, Marketing Analytics, Website & App analytics, Data Science, Data Engineering, Visualization, Forecasting, and Predictive Modelling solutions.
Role Description
The Data Engineer will develop and maintain scalable data pipelines using AWS services, and will be responsible for data acquisition, data transformation, and data modeling. The Data Engineer will also be responsible for collaborating with cross-functional teams to design and develop data solutions that meet business requirements, as well as creating and maintaining technical documentation for system design, development and testing.
Our technology stack includes AWS, Postgres SQL, MySQL, Looker, Tableau, Python, Docker, Apache Airflow, AWS Glue, etc. We work with diverse data sources, including data from various SaaS platforms, Google Sheets, 3rd-party APIs, Google, Facebook, and more.
Responsibilities
- Design data pipelines to curate sourced data into the Redshift data warehouse
- Build and maintenance of data pipelines and data platforms with tools such as Airflow, AWS Glue
- Explore ways to enhance data quality and reliability
- Develop analytical tooling to better support BI and Advanced Data Analytics activities
- Promote and champion data engineering standards and best-in-class methodology
Requirements
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
- 2-5 years of hands-on experience in data engineering with AWS services (S3, EMR, RDS, DynamoDB, Redshift, etc.)
- Strong SQL skills
- Strong programming skills with experience in scripting languages such as Python or Java
- Experience in data modeling, ETL/ELT frameworks, data warehousing and BI concepts
- Experience in creating and managing data warehouses and databases - Snowflake, PostgreSQL, MS SQL, MySQL, Redshift, etc.
- Understanding of web protocols (HTTP, FTP) and web services (REST APIs)
- Good understanding of data analysis and data science concepts
- Strong critical-thinking, analytical and problem-solving skills
- Excellent communicator with team-oriented approach
-
Data Engineer
2 weeks ago
Mumbai, India Domnic Lewis International Full timeKey Deliverables : 1. Implement data ingestion processes to extract data from various sources, including databases, APIs, and streaming platforms.2. Develop and maintain Extract, Transform, Load (ETL) pipelines using AWS Glue, AWS Lambda, or custom scripts.3. Perform data cleansing activity such as removing spaces, upper/lower, drop duplicate data, Renaming...
-
Data Engineer
1 month ago
mumbai, India Huquo Full timePosition : Data EngineerLocation : MumbaiExperience : 4-6 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...
-
Data Engineer
2 weeks ago
Mumbai, India Huquo Full timePosition : Data EngineerLocation : MumbaiExperience : 4-6 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...
-
Data Engineer
2 weeks ago
Mumbai, India Huquo Full timePosition : Data EngineerLocation : MumbaiExperience : 4-6 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...
-
Data Engineer
4 weeks ago
Mumbai, Maharashtra, India Huquo Full timePosition : Data EngineerLocation : MumbaiExperience : 4-6 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...
-
AWS Data Engineer
2 weeks ago
Bangalore/Chennai/Pune/Mumbai, India Voyager Partners Full timeCompany : Mastek Digital (https :// Overview :We are looking for a talented AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on the AWS platform. Your expertise in AWS services and data engineering will be critical in building scalable,...
-
Ventura - Data Engineer - SQL/AWS
1 month ago
mumbai, India Ventura Securities Ltd. Full timeJob description :About us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable franchise with 1000+ employees...
-
Oneture Technologies
2 weeks ago
Mumbai/Navi Mumbai/Pune, India Oneture Technologies Full timeRole : Data Engineer (AWS)Location : Mumbai, PuneExperience : 1 to 3 yrsTechnologies / Skills : Advanced SQL, AWS, ETL pipelines development and optimization, Data Modelling, Spark - Scala/Python, Airflow, KafkaJob Overview : We are looking for a Data Engineer to join our data team to solve data-driven critical business problems. You will be responsible for...
-
Oneture Technologies
4 weeks ago
Mumbai/Navi Mumbai/Pune, Maharashtra, India Oneture Technologies Full timeRole : Data Engineer (AWS)Location : Mumbai, PuneExperience : 1 to 3 yrsTechnologies / Skills : Advanced SQL, AWS, ETL pipelines development and optimization, Data Modelling, Spark - Scala/Python, Airflow, KafkaJob Overview :We are looking for a Data Engineer to join our data team to solve data-driven critical business problems. You will be responsible for...
-
AWS Data Engineer
2 weeks ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
AWS Data Engineer
4 weeks ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
Ventura - Data Engineer - SQL/AWS
2 weeks ago
Navi Mumbai, India Ventura Securities Ltd. Full timeJob description :About us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable franchise with 1000+ employees...
-
Ventura - Data Engineer - SQL/AWS
2 weeks ago
Thane/Mumbai/Navi Mumbai/Maharashtra, India Ventura Securities Ltd. Full timeJob description :About us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable franchise with 1000+ employees...
-
Ventura - Data Engineer - SQL/AWS
4 weeks ago
Thane/Mumbai/Navi Mumbai/Maharashtra, Maharashtra, India Ventura Securities Ltd. Full timeJob description :About us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable franchise with 1000+ employees...
-
Data Engineering Manager
1 month ago
Mumbai, India GAMIFi Consulting Services Pvt Ltd Full timePosition : Data Engineering ManagerFunctional Area : AWS Data EngineeringExperience : 10+ yrsJob Location : MumbaiJob Type : Permanent & Work From OfficeQualification : B.Tech / B.E / MCAResponsibilities : Research and develop designs and products. Lead research and development projects that produce new designs, products, and processes. Determine the need...
-
Data Engineer
2 weeks ago
mumbai, India Virtusa Full timeData Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security...
-
Data Engineer
2 weeks ago
Mumbai, India Virtusa Full timeData Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer. Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data Security...
-
AWS DevOps Engineer
2 weeks ago
Pune/Mumbai/Maharashtra/Navi Mumbai, India fingertips data intelligence solutions Full timeWalking drive in Pune for aws devops (Saturday 1st March'24)JD - AWS DevOps Engineer- Bachelor's degree in Computer Science, Information Technology, or related field.- 5+ years of experience in DevOps or SRE.- In-depth knowledge of cloud services and its best practices AWS preferable.- Ability to provide support and maintain AWS/Azure any cloud...
-
Cloud Support Engineer
2 days ago
mumbai, India AWS India - Maharashtra - D03 Full timeAmazon Web Services is the global market leader and technology forerunner in the Cloud business. As a member of the AWS Support team, you will be at the forefront of this transformational technology, assisting a global list of companies and developers that are taking advantage of a growing set of services and features to run their mission-critical...
-
Data Engineer
1 month ago
mumbai, India Anicalls (Pty) Ltd Full timeCandidate should have: Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborate Strong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud setting Understanding of ELK stack is a plus for logging and reporting purposes...