Data Engineer
2 weeks ago
AWS Glue Snowflake.
Experience : 6+years.
Locations : Pune,Mumbai,Chennai,Bangalore.
Job Description
- Data Engineer with experience using AWS Glue with experience in Snowflake and a good understanding of dbt (data build tool).
- The candidate will have a strong background in data engineering, with hands-on experience in building and optimizing ETL pipelines using AWS Glue, as well as familiarity with Snowflake for data warehousing and dbt for data transformation and modeling.
Key Responsibilities :
- Develop and maintain ETL pipelines using AWS Glue to extract, transform, and load data from various sources into data lake and data warehouse.
- Collaborate with data architects, analysts, and stakeholders to understand data requirements and implement solutions that meet business needs.
- Optimize ETL processes for performance, scalability, and reliability, ensuring efficient data ingestion and processing.
- Implement and maintain data models and transformations using dbt to enable efficient data analysis and reporting.
- Work closely with cross-functional teams to troubleshoot issues, identify root causes, and implement solutions in a timely manner.
- Stay up-to-date with industry best practices and emerging technologies in data engineering and cloud computing, and recommend improvements to existing systems and processes.
- Document technical specifications, data flows, and system architecture diagrams to ensure clarity and maintainability of ETL pipelines and data models.
- Provide technical guidance and support to junior team members, fostering a collaborative and knowledge-sharing environment.
Qualifications :
- Bachelor's degree in Computer Science, Engineering, or a related field;.
- Minimum of 2 years of hands-on experience in developing ETL pipelines using AWS Glue, with proficiency in Python programming and AWS services (S3, Lambda, IAM, etc.
- Familiarity with Snowflake or similar cloud-based data warehouse platforms, including data modeling and SQL querying.
- Good understanding of dbt (data build tool) for data transformation and modeling, with practical experience preferred.
- Strong analytical and problem-solving skills, with the ability to analyze complex data issues and implement effective solutions.
- Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
- Experience working in an Agile environment with version control systems (e.g., Git) and CI/CD pipelines is a plus.
- AWS certification (e.g., AWS Certified Developer, AWS Certified Data Analytics Specialty) is desirable but not required.
-
Azure Data Engineer
3 weeks ago
Pune/Bangalore/Chennai, IN Growel Softech Pvt. Ltd. Full timeJob Title : Azure Data EngineerLocations : Pune, Bangalore, ChennaiExperience Required : 4 - 10 yearsJob Description :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering with hands-on experience in designing and implementing data solutions using Microsoft Azure....
-
Data Engineer
3 weeks ago
Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full timePosition Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...
-
Data Engineer
2 months ago
Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full timePosition Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...
-
Data Quality Engineer
3 days ago
Chennai/Pune, IN IMS consulting company Full timeJob Description :As a Manager of Data Quality Engineering, you will lead a team responsible to ensure the accuracy, integrity, and reliability of data across the organization. You will collaborate closely with various stakeholders including data engineers, data scientists, product managers, and business analysts to establish and maintain robust data quality...
-
Data Engineer
3 weeks ago
Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full timeJob Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...
-
Data Engineer
3 weeks ago
Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full timeJob Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...
-
Big Data Engineer
3 days ago
Mumbai/Bangalore/Pune, IN Techno Wise Full timeJob Role : Big Data EngineerRelevant Experience : 3+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a...
-
Aptus Data Labs
3 days ago
Mumbai/Bangalore/Hyderabad/Gurgaon/Gurugram, IN Aptus Data Labs Full timeRole - Data Scientist (Azure)Location - Bangalore/Hyderabad/Mumbai/Gurgaon (Onsite)Apply if you can join us within 30 days.The ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract valuable insights from highly complex data sets to ask the right questions and...
-
Aptus Data Labs
2 weeks ago
Bangalore/Hyderabad/Gurgaon/Gurugram/Mumbai, IN Aptus Data Labs Full timeDescription :We are seeking an experienced and talented individual for the position of Data Governance with Azure experience. In this role, you will be responsible for managing the data governance framework using Azure tools and technologies, and collaborating closely with cross-functional teams to implement and maintain best practices.Location :...
-
Senior Data Engineer
3 days ago
Bangalore/Chennai/Hyderabad, IN PPLABILITY PRIVATE LIMITED Full timeJob Title: Senior Data Engineer-Data Modeling. Location: Bengaluru, Chennai, about the role? What your typical day would look like? As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team...
-
Manager - Data Quality Engineering
2 days ago
Chennai/Pune, IN Nexionpro Services LLP Full timeYears of Exp : 15+ yearsSkills : Python, Pytest, AWS-Lambda, Glue, SQL, MDMLocation : Chennai and PuneNotice Period : Immediate - 60 daysAs a Manager of Data Quality Engineering, you will lead a team responsible to ensure the accuracy, integrity, and reliability of data across the organization. You will collaborate closely with various stakeholders including...
-
AWS Data Engineer
1 month ago
Bangalore/Pune, IN Technomech Placements Full timeThis is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...
-
AWS Data Engineer
3 weeks ago
Bangalore/Pune, IN Technomech Placements Full timeThis is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...
-
Big Data Engineer
2 months ago
Bangalore/Chennai/Pune, IN ADVANSOFT Full timeWe are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...
-
Big Data Engineer
3 weeks ago
Bangalore/Chennai/Pune, IN ADVANSOFT Full timeWe are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...
-
Data Engineer
2 months ago
Pune/Bangalore/Chennai, IN ADVANSOFT Full timeSkills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and...
-
Data Engineer
2 weeks ago
Bangalore/Pune, IN Xcelyst Full timeRole : Data Engineer - NifiExperience : 5 Years - 8 Years Notice period : Immediate - 30 daysSkills : Experience in Nifi and Data Engineering (Pyspark, SQL, ETL). Secondary : Big Data/Hadoop, Hive, Spark4+ Years in Data Engineer/1-2 yrs exp in Nifi We are seeking a highly skilled Data Engineer with expertise in Apache NiFi to join our data engineering team....
-
Big Data Engineer
3 days ago
Mumbai/Pune/Bangalore, IN Techno Wise Full timeJob Description : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a pivotal role in designing, implementing, and maintaining scalable data solutions leveraging the Big Data technologies like PySpark. This role requires a strong understanding of big data technologies, data engineering...
-
AWS Data Engineer
3 weeks ago
Chennai/Pune/Bangalore/Noida, IN Ilink Systems Pvt Ltd Full timeJob Description :- AWS Data Engineer with min of 5 to 7 years of experience.- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.- Connect with stakeholders daily to discuss project progress and updates.- Work within an Agile process to deliver projects in a timely and efficient manner.- Design and...
-
AWS Data Engineer
3 weeks ago
Chennai/Pune/Bangalore/Noida, IN Ilink Systems Pvt Ltd Full timeJob Description :- AWS Data Engineer with min of 5 to 7 years of experience.- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.- Connect with stakeholders daily to discuss project progress and updates.- Work within an Agile process to deliver projects in a timely and efficient manner.- Design and...