Senior Data Engineer
2 days ago
Description :
Position : Senior Data Engineer (AWS / GCP)
Work Location : Pune
Mode : Work from office
Description :
The Senior Data Engineer will be responsible for designing, building, and maintaining high-performance, scalable data pipelines to support our consulting and analytics solutions. The Senior Data Engineer will work with cross-functional teams to develop and implement data models, ETL processes, and data warehousing solutions.
Responsibilities :
- Create and maintain optimal Data Lake setup.
- Assemble large and complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing big data data pipelines, architectures and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
- Strong project management and organizational skills.
- Experience supporting and working with cross-functional teams in a dynamic environment.
Technical Expertise :
years experience in Data Analytics / Data Engineering
- Experience with Data Analytics services like EMR, Glue, Athena, Kinesis, MSK, Elasticsearch, Quicksight and Redshift.
- Experience with Data Lake setup and Data warehouse on AWS/GCP.
- Experience with big data tools : Hadoop, Spark, Kafka, Hive etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with data pipeline and workflow management tools : Azkaban, Luigi, Airflow, etc.
- Experience with stream-processing systems : Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages : Python, Scala, etc
- Experience with setting up HPC (High Performance Computing)
- Experience working with cloud platforms (e.g. AWS, Azure, Google Cloud) and knowledge of machine learning concepts and algorithms are also desirable qualifications.
-
Senior QE Engineer
2 days ago
Pune, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per yearReq ID: 330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QE Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I (JavaScript)...
-
Data Engineer
2 days ago
Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDo you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...
-
Senior Data Engineer
6 days ago
Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearSenior Data EngineerSenior Data EngineersBuild and maintain data pipelines to support AI initiatives. Ensure data quality, integrity, and availability.Design and build ETL/ELT pipelinesSQL/NoSQL, Spark/Kafka, Airflow, ETL/ELT pipeline development; data governance, schema enforcementVector databases (Milvus, Pinecone), data lineage toolsDesign and build...
-
Senior Data Analyst
1 week ago
Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Hevo:Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data integration...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India NCSI Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Title: Senior Data Engineer Company Name: NCSi Job Description: NCSi is seeking a highly skilled Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and optimizing data pipelines and architectures to support our data-driven initiatives. You will collaborate with cross-functional teams to...
-
Senior Data Engineer
6 days ago
Pune, Maharashtra, India BlueCloud Full time ₹ 20,00,000 - ₹ 25,00,000 per yearResponsibilitiesWe are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience withDBT and Snowflake. The Senior Data Engineer will be responsible for building, maintaining, and optimizing data pipelines, as well as implementing...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India Vanderlande Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob TitleSenior Data EngineerJob DescriptionIf you are passionate about unlocking the power to gain next level insights into a great variety of data, powering data driven decision making through advanced analytics and data science practises, you might have just found your perfect next career step.In this job you will have versatile responsibilities,...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India True Talents Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title :Senior Data EngineerLocation :Pune / NoidaExperience :4 - 8 YearsEmployment Type :Full-timeNotice Period :Up to 30 DaysAbout The RoleWe are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate should have strong expertise in modern data engineering tools,...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India NCS Group Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Title: Senior Data EngineerCompany Name: NCSiJob Description:NCSi is seeking a highly skilled Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and optimizing data pipelines and architectures to support our data-driven initiatives. You will collaborate with cross-functional teams to understand...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India Populace World Solutions Full time ₹ 8,00,000 - ₹ 20,00,000 per yearDescription : Location : Pune (Kharadi), India Experience : 8 YearsAbout the Role : We are seeking a highly skilled and experienced Senior Data Engineer to join our team in Pune. This role is crucial for designing, building, and optimizing our large-scale data processing systems and platforms. As a senior member of the team, you will apply your...