
Senior Specialist- Data Engineer
2 weeks ago
Roles & Responsibilities:
- Total 8-10 years of working experience Experience/Needs:
- 8-10 Years of experience with big data tools like Spark, Kafka, Hadoop etc.
- Design and deliver consumer-centric high performant systems.
- You would be dealing with huge volumes of data sets arriving through batch and streaming platforms.
- You will be responsible to build and deliver data pipelines that process, transform, integrate and enrich data to meet various demands from business
- Mentor team on infrastructural, networking, data migration, monitoring and troubleshooting aspects
- Focus on automation using Infrastructure as a Code (IaaC), Jenkins, devOps etc.
- Design, build, test and deploy streaming pipelines for data processing in real time and at scale
- Experience with stream-processing systems like Storm, Spark-Streaming, Flink etc..
- Experience with object-oriented/object function scripting languages: Scala, Java, etc.
- Develop software systems using test driven development employing CI/CD practices
- Partner with other engineers and team members to develop software that meets business needs
- Follow Agile methodology for software development and technical documentation
- Good to have banking/finance domain knowledge
- Strong written and oral communication, presentation and interpersonal skills.
- Exceptional analytical, conceptual, and problem-solving abilities
- Able to prioritize and execute tasks in a high-pressure environment
- Experience working in a team-oriented, collaborative environment
- 8-10 years of hand on coding experience
- Proficient in Java, with a good knowledge of its ecosystems
- Experience with writing Spark code using scala language
- Experience with BigData tools like Sqoop, Hive, Pig, Hue
- Solid understanding of object-oriented programming and HDFS concepts
- Familiar with various design and architectural patterns
- Experience with big data tools: Hadoop, Spark, Kafka, fink, Hive, Sqoop etc.
- Experience with relational SQL and NoSQL databases like MySQL, PostgreSQL, Mongo dB and Cassandra
- Experience with data pipeline tools like Airflow, etc.
- Experience with AWS cloud services: EC2, S3, EMR, RDS, Redshift, BigQuery
- Experience with stream-processing systems: Storm, Spark-Streaming, Flink etc.
- Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc.
- Expertise in design / developing platform components like caching, messaging, event processing, automation, transformation and tooling frameworks
Location: Pune/ Mumbai/ Bangalore/ Chennai
-
Senior Data Engineering Specialist
2 weeks ago
Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Senior Data Engineering SpecialistAbout the RoleWe are seeking an experienced and innovative data engineering professional to join our team as a Senior Data Engineering Specialist. The ideal candidate will have a strong background in designing, building, and maintaining large-scale data architectures.ResponsibilitiesDesign and implement...
-
Senior Data Engineering Specialist
2 weeks ago
Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Data Engineering SpecialistWe are seeking a highly skilled Senior Data Engineering Specialist to join our team. The ideal candidate will have extensive experience in designing, developing, and implementing large-scale data integration pipelines using Informatica BDM/DEI.Job Description:This is a full-time on-site role for a seasoned data engineer...
-
Senior Data Engineering Specialist
1 week ago
Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Senior Data Engineering Specialist">About the Position:We are seeking an experienced Senior Data Engineering Specialist to join our team and contribute to the development, optimization, and maintenance of data pipelines and architectures.The ideal candidate will have in-depth knowledge of Microsoft data engineering ecosystem, particularly...
-
Senior Data Engineering Specialist
2 weeks ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 10,50,000 - ₹ 15,50,000Job Title: Senior Data Engineering SpecialistWe are seeking a highly skilled and experienced Senior Data Engineering Specialist to join our team. In this role, you will be responsible for designing and implementing efficient data pipelines, architectures, and data sets. You will also collaborate closely with cross-functional teams to develop and maintain...
-
Senior Data Specialist
2 weeks ago
Pune, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000Senior Data SpecialistWe are seeking a highly skilled and motivated professional to fill the position of Senior Data Specialist. The ideal candidate will have a strong foundation in SQL, experience with Python development, and a background in Computer Engineering or Computer Science.The successful applicant will design, develop, and maintain efficient,...
-
Data Senior Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per yearReq ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...
-
Senior Data Engineering Specialist
3 days ago
Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878Job Title: Senior Data Engineering SpecialistAbout the RoleThis is a unique opportunity to work as a senior data engineering specialist and contribute your expertise to the development of our cutting-edge data pipeline. Your primary responsibility will be to design, implement, and maintain scalable, efficient, and reliable data processing systems using...
-
Senior Data Engineering Specialist
3 days ago
Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 8,00,000Job Title: Senior Data Engineering Specialist">As a key member of our team, you will be responsible for defining and driving the technical architecture for migrating Azure SQL databases to Google BigQuery. This involves architecting an end-to-end GBQ migration framework, ensuring schema optimization, data ingestion patterns, and query performance.">Our ideal...
-
Senior Associate Data Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full timeJob DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...
-
Data Engineer
6 days ago
Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per yearAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...