Lead Data Engineer
2 months ago
Job Title : Lead Data Engineer
Location : Bangalore
Notice Period : Immediate - 15 Days
About the Role :
We are seeking a highly skilled Lead Data Engineer with extensive experience in data engineering and a strong background in Big Data technologies. The ideal candidate will have 7+ years of relevant experience, with expertise in Python, SQL, and AWS, and a proven track record in building scalable and high-performance cloud data lake solutions.
Top Skills :
- Python
- SQL
- AWS
- Spark
Key Responsibilities :
- Design, develop, and deploy scalable data engineering solutions.
- Work extensively with Hadoop and Big Data processing frameworks (Hadoop, Spark, Hive, Flink, Airflow, etc.).
- Utilize relational SQL and programming languages such as Python, Scala, or Java for data processing and analysis.
- Develop solutions in the AWS environment, focusing on services such as EMR, S3, Kinesis, Redshift, Athena, etc.
- Build real-time and high-performance cloud data lake solutions.
- Implement and manage source control using GitHub and related CI/CD processes.
- Work with Big Data streaming services like Kinesis and Kafka.
- Manage and utilize NoSQL data stores such as HBase and DynamoDB.
- Handle data warehouses/RDBMS like Snowflake and Teradata.
- Debug issues and assist the team in resolving technical challenges.
- Translate functional requirements into actionable designs and development plans from a data engineering perspective.
Qualifications :
- 7+ years of experience in the Data Engineering field.
- 5+ years of hands-on experience with Hadoop and Big Data processing frameworks.
- 5+ years of strong experience with relational SQL and at least one programming language such as Python, Scala, or Java.
- Proficiency in working with AWS services including EMR, S3, Kinesis, Redshift, Athena, etc.
- Proven ability to build scalable, real-time, and high-performance cloud data lake solutions.
- Experience with source control tools like GitHub and related CI/CD processes.
- Knowledge of Big Data streaming services like Kinesis, Kafka, etc.
- Familiarity with NoSQL data stores such as HBase, DynamoDB, etc.
- Experience with data warehouses/RDBMS like Snowflake and Teradata.
- Strong problem-solving skills with the ability to debug and resolve technical issues.
-
Solution Engineer
2 months ago
Bangalore, Karnataka, India HEVO DATA Full timeOverview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...
-
Lead Data Engineer
2 months ago
Bangalore, Karnataka, India Sentienz Full timeJob Description : As a Lead Data Engineer, you will play a pivotal role in driving our data-driven initiatives. You will be responsible for designing, developing, and maintaining robust data engineering solutions that support our analytics and decision-making processes.Responsibilities :- Lead and mentor a team of data engineers, providing technical guidance...
-
Technical Lead
1 month ago
Bangalore, Karnataka, India FxConsulting Full timeJob Title : Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer with expertise in Big Data technologies to join our dynamic team. As a Lead Data Engineer, you will play a pivotal role in designing, building, and optimizing large-scale data pipelines and systems to drive business insights and innovation.Key Responsibilities :1. Design,...
-
MakeMyTrip - Lead Data Engineer
2 months ago
Bangalore, Karnataka, India MakeMyTrip Full timeOur main focus is on Scala , Spark , Spark Streaming .MakeMyTrip - Lead Data EngineerAbout the Role :MakeMyTrip, India's leading online travel company, is searching for a seasoned Lead Data Engineer to join our Data Platform Team. You will play a pivotal role in architecting, developing, and managing our data infrastructure and pipelines, empowering...
-
Technical Lead
2 months ago
Bangalore, Karnataka, India HireVeda Full timeHireVeda has been mandated to hire a Technical Lead (Data Engineer) for a B2B SaaS Pioneer, backed by renowned Investors, which is revolutionizing SaaS : - Proven experience of 5-9 years in data engineering, including data pipeline design, ETL processes, data warehousing, and managing data at the terabyte scale - Minimum 4 years of experience in Product...
-
Software Development Engineer II
2 months ago
Bangalore, Karnataka, India HEVO DATA Full timeAbout Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...
-
Lead Data Engineer
2 months ago
Bangalore, Karnataka, India Rigel Networks Pvt Ltd Full timeLead Data Engineer :Top Skills :- Python- SQL- AWS- Spark- 7+ years relevant work experience in the Data Engineering field- 5+ years of experience working with Hadoop and Big Data processing frameworks (Hadoop, Spark, Hive, Flink, Airflow etc.)- 5+ years of Strong experience with relational SQL and at least one programming language such as Python, Scala, or...
-
Lead Data Engineer
2 months ago
Bangalore, Karnataka, India TheBriminc Full timePosition : Senior Data Engineer/ Lead Data Engieer. Location : Bangalore. Experience Required:.- Minimum 5+ years' Experience in Data Engineering.- Must have good knowledge and experience in Python.- Must have good Knowledge of Pyspark.- Mush have good Knowledge of Databricks.- Must have good experience in AWS (Glue, Athena, Redshift, EMR).- Typically...
-
Perfios Software Solutions
1 month ago
Bangalore, Karnataka, India PERFIOS SOFTWARE SOLUTIONS PRIVATE LIMITED Full timeJob Description : Tech Lead Data EngineerPosition Overview : We are looking for a seasoned Tech Lead Data Engineer with a robust technical background and leadership experience to spearhead our data engineering efforts. This role demands a deep expertise in Python, PySpark, and Shell scripting, along with a comprehensive understanding of AWS cloud services....
-
Head - Data Engineering
4 weeks ago
Bangalore, Karnataka, India Merck Group Full timeJob Description : Join us to contribute to the org's enterprise priority of driving innovation through data & digital. In R&D, the promise of bringing more medicines to more patients faster is closely linked with the ability to maximize the use of our data for improved decision making using data analytics & AI. For this, having high-quality data readily...
-
Big Data Engineer/Lead
1 month ago
Bangalore, Karnataka, India TekPillar Full timeJoin our dynamic team in Bangalore as a Big Data Engineer contribute to our key data engineering initiatives! You will play a crucial role in managing and prioritizing projects while driving strategies and executing data engineering solutions.Job Title : Big Data Engineer/ LeadExperience : 4 to 9 YearsLocation : BangaloreKey Responsibilities : - Collaborate...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India Coders Brain Technology Private Limited Full timeRole : Data Engineer (no one over 10 years of experience will be considered)Qualifications :- Bachelor's degree in Computer Science/Engineering or similar- 5 to 7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines- Proficiency with Cloud Platforms like Azure(preferred), AWS,...
-
Senior Data Engineering
1 month ago
Bangalore, Karnataka, India FxConsulting Full timeJob Title : Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer with expertise in Big Data technologies to join our dynamic team. As a Lead Data Engineer, you will play a pivotal role in designing, building, and optimizing large-scale data pipelines and systems to drive business insights and innovation.Key Responsibilities : - Design,...
-
KredX - Senior/Lead Data Integration Engineer
2 months ago
Bangalore, Karnataka, India Kredx Finance Private Limited Full timeJob Description - Senior/Lead Data Integration EngineerPosition - Senior/Lead Data Integration EngineerExperience - 4-7 yearsWork Location - BangaloreCompany Overview :KredX is a supply chain finance powerhouse which emerged in India, and now has an evolving global footprint. With a new-age plug-and-play ecosystem of working capital finance and cash...
-
Infiniti Research
2 months ago
Bangalore, Karnataka, India Infiniti Research Limited Full timeCompany : Quantzig Analytics. Location : Kadubeesanahalli, Bangalore. Experience : 6+ years minimum is required. Notice : Preferably 0 to 30days. Job Description : - Seeking a self-driven professional with a strong ownership mentality and the ability to work independently without constant guidance. - The ideal candidate will have an agile mindset, capable...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India Coders Brain Technology Private Limited Full timeQualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...
-
Bangalore, Karnataka, India Cloudcover Consultancy Private Limited Full timeJob brief : We are seeking a highly skilled and experienced Engineering Manager Data Insights to join our team who has at least 10 years of experience in data engineering and data science, with significant experience in managing teams and delivering large scale projects. This role will be pivotal in driving the strategy, design, and implementation of our...
-
Senior Data Engineer
2 months ago
Bangalore, Karnataka, India MonoSpear Technologies Pvt Ltd Full timeSenior Data Engineer :- 9+ years' work experience and bachelor's degree in Information Science, Computer Science, Mathematics, Statistics or a quantitative discipline in science, business, or social science.- Hands-on engineer who is curious about technology, should be able to quickly adopt to change and one who understands the technologies...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India Prydan Consultancy Full timeCompany Description : PRYDAN Consultancy Services is a global staffing solutions provider committed to excellence in recruitment services across various industries. With a focus on matching the right talent with the right opportunities, we empower clients and candidates to thrive in today's competitive landscape. Our comprehensive recruitment services...
-
Lead Big Data Engineer
1 month ago
Bangalore, Karnataka, India TekPillar Full timeJob Title : Senior Data Engineer (Big Data)Experience : 4-9 YearsLocation : BangaloreJob Overview : We are seeking a skilled Senior Data Engineer to coordinate with cross-functional teams, manage and prioritize projects, and drive key data engineering initiatives. The successful candidate will have a deep understanding of big data tools and the ability to...