Senior Data Engineer
4 weeks ago
Description : Position : Senior Data Engineer (AWS / GCP)Work Location : PuneMode : Work from officeDescription : The Senior Data Engineer will be responsible for designing, building, and maintaining high-performance, scalable data pipelines to support our consulting and analytics solutions. The Senior Data Engineer will work with cross-functional teams to develop and implement data models, ETL processes, and data warehousing solutions.Responsibilities : - Create and maintain optimal Data Lake setup.- Assemble large and complex data sets that meet functional / non-functional business requirements.- Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL.- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.- Experience building and optimizing big data data pipelines, architectures and data sets.- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.- Build processes supporting data transformation, data structures, metadata, dependency and workload management.- Working knowledge of message queuing, stream processing, and highly scalable big data data stores.- Strong project management and organizational skills.- Experience supporting and working with cross-functional teams in a dynamic environment.Technical Expertise : - 5+ years experience in Data Analytics / Data Engineering- Experience with Data Analytics services like EMR, Glue, Athena, Kinesis, MSK, Elasticsearch, Quicksight and Redshift.- Experience with Data Lake setup and Data warehouse on AWS/GCP.- Experience with big data tools : Hadoop, Spark, Kafka, Hive etc.- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.- Experience with data pipeline and workflow management tools : Azkaban, Luigi, Airflow, etc.- Experience with stream-processing systems : Storm, Spark-Streaming, etc.- Experience with object-oriented/object function scripting languages : Python, Scala, etc- Experience with setting up HPC (High Performance Computing)- Experience working with cloud platforms (e.g. AWS, Azure, Google Cloud) and knowledge of machine learning concepts and algorithms are also desirable qualifications. (ref:hirist.tech)
-
Data Engineer Senior Consultant
2 weeks ago
Pune, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Pune, Mahrshtra (IN-MH), India (IN). Location: | Experience: 5+...
-
Senior Data Engineer
3 weeks ago
Pune, India AIQU Full timeWe are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...
-
Senior Data Engineer
3 weeks ago
Pune, India AIQU Full timeWe are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...
-
Senior Data Engineer
3 weeks ago
Pune, India Whatjobs IN C2 Full timeTitle and Summary Senior Data Engineer Job Description Summary Senior Data Engineer (DW) Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks,...
-
Data Engineer
2 days ago
Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDo you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...
-
Senior Data Engineer
1 week ago
Pune, India Sourcebae Full timeJob Alert: Senior Data Engineer (4-6 Yrs) | Python, Spark, Snowflake Are you an experienced Data Engineer passionate about building and optimizing scalable data platforms? We're looking for an independent problem-solver to join our team in Bangalore or Pune and deliver robust data solutions! Role Details Job Title: Data Engineer (Senior Level) Experience:...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India Jet2 Travel Technologies Pvt Ltd. Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearJob Title –Senior Developer - Data EngineeringJob Type –Permanent Relevant Experience – 7+yearsof experience in the field of Datawarehouse, Data Engineering, Big Data, Cloud & Analytics, Data VisualizationReports into –Team Lead - Data EngineeringJob Description:We, at Jet2 (UK's third largest airlines and the largest tour operator), have set up a...
-
Senior Data Engineer
6 days ago
Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearSenior Data EngineerSenior Data EngineersBuild and maintain data pipelines to support AI initiatives. Ensure data quality, integrity, and availability.Design and build ETL/ELT pipelinesSQL/NoSQL, Spark/Kafka, Airflow, ETL/ELT pipeline development; data governance, schema enforcementVector databases (Milvus, Pinecone), data lineage toolsDesign and build...
-
Senior Data Engineer
3 weeks ago
Pune, India Whatjobs IN C2 Full timeCompany: Dataceria software solutions Pvt ltd. Job Position: Senior Data engineer _snowflake Location: Pune Timings to align with UK and USA timings Hybrid: 3 days in NT office Pune Interview stages: 1, initial screening, 2 stages client technical interview Start date: asap Dataceria is looking for a Senior Data Engineer to join our growing Data Delivery...
-
Senior Data Engineer
1 week ago
Pune, India Jobted IN C2 Full timeResponsibilities: Job Title: Senior Developer - Data Experience: 4-7 yrs Role Overview We are looking for a Senior Data Engineer with 5+ years of experience in data engineering to lead the design, development, and maintenance of data architecture and pipelines. The candidate will provide technical leadership, mentor junior engineers, and drive best practices...