Senior Lead Data Engineer
1 month ago
Job Description :
Must-Have :
- 10+ years of experience in software development and delivery.
- 5 to 7 years of relevant work experience on large-scale Data applications
- Good aptitude, strong problem-solving abilities, and analytical skills
- Should have team handling experience , leading team of 6-7 members OR handle 2-3 smaller teams
- Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.
Should have good working experience on :
- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet
- Spark - Batch Processing
- Setting ETL pipelines
- Python or Java programming language is mandatory.
- Worked in data Lake , Data warehousing Domain in Cloud Environment
- Exposure to Snowflake , Redshift or other Distributed Data Warehousing System
- Experience working in Agile Methodology
- Ability to learn and help the team learn new technologies quickly
- Take up the complete of the project with strong sense of owenership.
- Excellent communication and coordination skills
- Knowledgeable (and preferred hands-on) - UNIX environments, different CICD tools, Scheduling tools like Autosys , Airflow etc.
- Must be able to integrate quickly into the team and work independently towards team goals.
Nice to Have :
- Experience in any of the cloud (AWS/Azure/GCP) , preferred is AWS
- Good to have experience in Snowflake
Role & Responsibilities :
- Take the complete responsibility for the project execution
- Be accountable for the delivery of the project in the defined timelines with good quality
- Define and follow the processes for project execution and delivery.
- Drive and motivate the team to be agile and follow agile methodology
- Guide the team technically and give the team a direction on how to plan, design, implement and deliver the projects.
- Define the architecture and discuss the pros-cons of the same with the team
- Involve the team during the brainstorming sessions as appropriate.
- Work with other team leads to get the architecture reviewed.
- Work with the clients and counterparts (in the US) to drive the project execution.
- Keep all the stakeholders updated about the project status/risks/issues if there are any.
- Work closely with the management wherever and whenever required, to ensure smooth execution and delivery of the project.
- Should be comfortable travel to Pune as and when required
Key Skills : Java / Python , Spark, Snowflake, AWS
Education : BE/B.Tech from a reputed institute.
-
Lead Data Engineer
1 month ago
Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full timeJob Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...
-
Lead/Senior Azure Data Engineer
3 weeks ago
Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full timeAbout Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...
-
Lead Data Engineer
7 hours ago
Hyderabad/Bangalore/Pune, IN SKANDHA IT SERVICES PRIVATE LIMITED Full timeLead Data Engineer Locations : Hyderabad, Bengaluru, Pune. Skills :- Programming : Python , Pyspark/Scala, Flask.- API Microservices , ECS Fargate.- Bigdata AWS : EMR, Glue, Athena, Redshift, Lambda.- Analytics : AWS Quicksight.- Database : Postgres RDS,Mongo (SQL/NoSQL).- Orchestration : preferably Airflow.About the Role : We are searching for a talented...
-
Senior Data Engineer
1 month ago
Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full timeJob Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...
-
Senior Big Data Engineer
1 month ago
Bangalore/Pune, IN Recrud Full timeSenior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...
-
AWS Data Engineer
3 weeks ago
Bangalore/Pune, IN Technomech Placements Full timeThis is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...
-
Senior/Lead DevOps Engineer
1 month ago
Bangalore/Pune, IN Squareroot Consulting Pvt Ltd Full timeWe are hiring Senior/Lead DevOps Engineer for the team of world-class engineers who have very good practice in building high-quality enterprise platform for globe.Role : Senior/Lead DevOps EngineerExperience : 5 to 15 YrsEducation : BE/BTech or ME/MTech from any of the premium institute.Salary Budget : 40 to 65 Lacks Per AnnumLooking for a someone who is...
-
Lead/Senior Data Scientist
4 weeks ago
Noida/Bangalore, IN Programming.com Full timeSenior Data Scientist/ Lead data ScientistOverview :We are seeking an experienced Senior Data Scientist to join our team with a focus on leveraging data-driven insights to solve complex business problems. The ideal candidate should have a strong background in SQL and Python, with a minimum of 5 years of relevant experience. Additionally, proficiency in...
-
Senior Data Engineer
1 month ago
Bangalore/Kolkata/Pune, IN Nilasu consulting Full timeSummary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...
-
Senior Data Engineer
7 hours ago
Bangalore/Hyderabad/Pune/Gurgaon/Gurugram/Noida/Greater Noida, IN Publicis Sapient Full timePublicis Sapient Overview : We at Publicis Sapient, enable our clients to thrive in Next and to create business value through expert strategies, customer-centric experience design, and world-class product engineering.The future of business is disruptive, transformative and becoming digital to the core.In our 20 + years in IT, never before have we seen such a...
-
Lead Data Engineer
3 weeks ago
Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full timeWe are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...
-
Senior Data Engineer
2 weeks ago
Pune/Mysore, IN IT Full timeWe are seeking a talented Senior Data Engineer with a strong background in developing ETLs and data pipelines using Apache Spark with the PySpark library. The ideal candidate will have proven experience in data modeling for data warehousing use cases, designing patterns, and building highly scalable and secure solutions. Additionally, experience with Azure...
-
Lead Data Engineer
1 month ago
Pune/Hyderabad/Gurgaon/Gurugram, IN LnS Infotech Full timePosition : Lead Data EngineerLocation : : 8+ YearsRoles & Responsibilities : This role is a hybrid across Data Engineering skill sets and DBA. Ideally someone with a background in Oracle DBA roles who has branched into data engineering.- 8+ years of hands-on experience in SQL, Py Spark & Python, should be experienced in shell scriptingJob Description :-...
-
Lead Data Engineer
2 weeks ago
Chennai/Cochin/Kochi/Coimbatore/Hyderabad, IN DigiMoksha Solutions Full timePosition : Lead Data EngineerExperience : 10-15 YearsLocation : Period : Immediate Description :As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal...
-
Senior Data Engineer
1 month ago
Bangalore/Chennai/Madurai, IN Resourcetree Full timeJob Description : As a Senior MDM Data Engineer with hands-on experience in Informatica Cloud MDM, you will be responsible for leading and executing end-to-end master data management (MDM) initiatives within our organization. Leveraging your deep technical expertise and practical experience, you will drive the design, implementation, and optimization of MDM...
-
AWS Data Engineer
4 weeks ago
Bangalore/Pune/Hyderabad, IN Kezan Consulting Full timeCompany Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...
-
Data Lead Engineer
1 month ago
Bangalore/Delhi, IN Squareroot Consulting Pvt Ltd Full timeJob Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...
-
Senior Data Engineer- Spark/Python
1 month ago
Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full timeWe are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...
-
Senior Data Engineer
1 month ago
Bangalore/Any Location, IN Randstad Full timeJob Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...
-
Senior Cloud Data Engineer
1 month ago
Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full timeSenior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...