Nsp - L5 - Bigdata
1 week ago
Company Overview Company Overview
Incedo is a US-based consulting, data science and technology services firm with over 2,500 people helping clients from our six offices across US and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and design capabilities coupled with deep domain understanding. We combine services and products to maximize business impact for our clients in telecom, financial services, product engineering and life science & healthcare industries.
Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep technology and domain experts, and global teams. Incedo University, our learning platform, provides ample learning opportunities starting with a structured onboarding program and carrying throughout various stages of your career. A variety of fun activities are also an integral part of our friendly work environment. Our flexible career paths allow you to grow into a program manager, a technical architect or a domain expert based on your skills and interests.
Role Description
**Role Description**: Data Engineer - Big Data
platforms. They must be at ease working in an agile environment with little supervision. The person should be a
self-motivated person with a passion for problem solving and continuous learning.
Role and responsibilities
- Project Management (50%)
- Front Door (Requirements, Metadata collection, classification & security clearance)
- Data pipeline template development
- Data pipeline Monitoring development & support (operations)
Technical skills requirements
- On-premise servers for data processing and extraction at our partners
- Five years of experience building production-quality software infrastructure
- Ability to own and deliver on large, multi-faceted projects Fluency in SQL and experience with RDBMSs
- (BigData, Spark, PySpark, Flink, sparkML, NiFi, Hive, Python, NoSql DBs)
- Experience designing and building big data pipelines
- Experience working on large scale, distributed systems
- Scala/Java/Python for micro-services and APIs. Docker and Kubernetes to package and run services
- HDP, Oracle skills & Sql; Spark, Scala, Hive and Oozie DataOps (DevOps, CDC)
Nice-to-have skills
- Docker/Kubernetes knowledge
- Jenkins, K8S
- Google Cloud certification
- Unix or Shell scripting
**Qualifications**:
- 5 - 12 Years of experience
- B.Tech., M.Tech. or MCA degree from a reputed university
Company Value Company Value
We are an Equal Opportunity Employer. We value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
