Streamsets Developer

Greetings from TCS TCS Hiring for StreamSets Developer Location: Hyderabad, Chennai, Indore, Noida, Pune, Kolkata Experience Range: 5 to 10 yrs Job Description: Required Technical Skill Set: Streamsets Data Collector to design, UnitTests, Deploy, Operate and maintain pipelines that streaming and batch jobs Must Have: 1. Hands-on experience with Streamsets (especially with Data Collectors and Control Hub) 2. Strong knowledge on SQL, ETL/ELT pipelines, and data integration patterns 3. Experience with real-time data processing and stream processing frameworks. 4. Experience with cloud environment and Data Lake/Warehouse. 5. Familiarity with Source control tools (e.G, Git) and CI/CD pipelines 6. Knowledge of Python, Scala or Java for scripting and automation. 7.Understanding data privacy, compliance, and governance framework Responsibility of / Expectations from the Role 1. Design, develop and deploy end-to-end data pipelines using StreamSets Data collector and StreamSets Control Hub. 2. Integrate data from diverse sources including relational databases, cloud storage (AWS/Azure/GCP), APIs, and streaming platforms like Kafka. 3. Collaborate with data architects and business analysts to understand data requirements and implement solutions accordingly. 4. Monitor data flows and troubleshoot issues related to data quality, latency, and pipeline failure. 5. Optimize Pipelines performance, reliability, and scalability.