Senior Data Engineer for Real-Time Streaming Pipelines
2 days ago
We are seeking a skilled Senior Data Engineer with a strong focus on building data streaming pipelines and a DevSecOps mindset. At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions.
Salary Range: ₹30-50 lakhs per annum, depending on experience
The ideal candidate will have extensive experience in data engineering, with proficiency in Java, Apache Beam or Flink, and experience in managing data streams for both batch and real-time use cases. If you are passionate about data processing and thrive in an Agile environment, we encourage you to apply.
Job Description
- Data Streaming Pipeline Development: Build and maintain data streaming pipelines that efficiently handle both batch and stream use cases, ensuring high performance and reliability.
- Data Analysis and Design: Conduct data analysis to inform the design of data pipelines and optimize data flows based on business requirements.
- Documentation: Create and maintain comprehensive documentation for data pipelines, including architecture, design decisions, and operational guidelines.
- Observability: Ensure proper observability is embedded into the design of data pipelines, implementing monitoring and logging to facilitate troubleshooting and performance optimization.
- DevSecOps Mindset: Embrace a DevSecOps culture, taking responsibility for the end-to-end lifecycle of the data pipeline: you build it, you run it. Ensure security and compliance are integrated into the development process.
- Data Modelling: Engage in data modeling activities to ensure efficient storage, retrieval, and processing of data in accordance with project specifications.
- Agile Participation: Actively participate in Agile ceremonies, including grooming user stories, estimation, and sprint planning, to ensure alignment with project goals.
- Testing: Conduct unit, functional, integration, and non-functional testing to verify data pipeline functionality and ensure high-quality deliverables.
Required Skills and Qualifications: Programming Language: Proficient in Java programming language. Streaming Technologies: Experience with Apache Beam or Flink for building data processing pipelines. Source Code Management: Familiarity with source code management using GitHub. API Consumption: Experience in consuming API endpoints for data integration. Database Management: Proficient with at least one enterprise-grade relational database (e.g., Oracle, SQL Server, PostgreSQL) and experience with at least one NoSQL database. Messaging Systems: Knowledge of Kafka for real-time data processing and streaming.
Benefits
- Diversity and Inclusion Initiative: We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company.
- Career Growth Opportunities: With top clients to boast about, Synechron has a global workforce of 13,950+, and has 52 offices in 20 countries within key global markets.
- Flexible Workplace Arrangements: Empowering our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.
-
Senior Data Engineer
3 hours ago
Bengaluru, Karnataka, India Synechron Full timeAbout the RoleWe are seeking a skilled Senior Data Engineer with a strong focus on building data streaming pipelines and ensuring security in our DevSecOps mindset. The ideal candidate will have extensive experience in data engineering, with proficiency in Java, Apache Beam or Flink, and experience in managing data streams for both batch and real-time use...
-
Bengaluru, Karnataka, India Confluent, Inc Full timeConfluent, Inc. is a leader in data streaming, empowering organizations to harness the power of real-time data to innovate and win in the modern digital world.We are seeking a highly skilled Cloud Enablement Engineer to join our team. This role will be at the intersection of engineering and education, empowering our users and prospects with the knowledge and...
-
Bengaluru, Karnataka, India Neuron7 Full timeAbout Neuron7.aiWe are a rapidly growing AI-first SaaS company focused on creating a category-defining service intelligence product. Our mission is to enhance service decision-making through advanced AI technology, and we are dedicated to delivering excellence in all aspects of our work.What We Offer:Competitive salary ($150,000 - $180,000) and equity....
-
Real-Time Data Processing Expert
3 weeks ago
Bengaluru, Karnataka, India Ahvi Infotech Full timeAbout the RoleWe are seeking a highly skilled Kafka Developer to join our team at Ahvi Infotech. The ideal candidate will have a strong background in Apache Kafka, Java, and distributed systems, with hands-on experience in building and optimizing Kafka-based applications.As a Kafka Developer, you will be responsible for creating high-performance and reliable...
-
Senior Big Data Engineer
3 weeks ago
Bengaluru, Karnataka, India IBCScorp Full timeAt IBCScorp, we are looking for a highly skilled Senior Big Data Engineer to lead our event streaming initiatives using Apache Kafka.As a key member of our engineering team, you will be responsible for designing and implementing data pipelines that integrate various data sources and sinks using Kafka. Your expertise in Kafka Streams and Connect will enable...
-
Senior DevSecOps Data Engineer
6 days ago
Bengaluru, Karnataka, India Synechron Full timeWe are seeking an exceptional Senior DevSecOps Data Engineer to join our team at Synechron. Located in Bangalore, this role offers a fantastic opportunity to leverage your expertise in building data streaming pipelines and implementing a DevSecOps mindset.Estimated Salary: ₹25 Lacs per annumAbout the Job:The ideal candidate will have extensive experience...
-
Senior Data Engineering Expert
4 days ago
Bengaluru, Karnataka, India Synechron Full timeAbout the OpportunityWe are seeking a skilled Senior Data Engineer with a strong focus on building data streaming pipelines and a DevSecOps mindset.The ideal candidate will have extensive experience in data engineering, with proficiency in Java, Apache Beam or Flink, and experience in managing data streams for both batch and real-time use cases.Key...
-
Bengaluru, Karnataka, India Synechron Full timeJob Title:Devsecops Engineer Role with Data Pipeline DevelopmentAbout the Company:Synechron is a global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions. Our company focuses on end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, serving...
-
Senior Software Engineer
6 days ago
Bengaluru, Karnataka, India RagaAI Inc Full timeJob DescriptionAbout RagaAI IncRagaAI Inc is an innovative AI-focused startup dedicated to developing cutting-edge stream processing systems and analytics solutions.Salary RangeThe estimated annual salary for this position is between $140,000 and $200,000, depending on experience.Key ResponsibilitiesWe are seeking a highly skilled Senior Software Engineer to...
-
Senior Data Engineering and DevSecOps Specialist
2 weeks ago
Bengaluru, Karnataka, India Synechron Full timeWe are seeking a highly skilled Senior Data Engineer with a strong focus on building data streaming pipelines and adopting a DevSecOps mindset to join our team at Synechron in Bangalore, India.The ideal candidate will have extensive experience in data engineering, with proficiency in Java, Apache Beam or Flink, and experience in managing data streams for...
-
Senior Data Engineering Lead
4 days ago
Bengaluru, Karnataka, India CareerXperts Consulting Full timeWe are seeking a highly experienced Senior Data Engineering Lead to join our team at CareerXperts Consulting.About the RoleThis is an exciting opportunity for a seasoned technical leader to drive the development and implementation of modern, real-time data platforms. As a key member of our team, you will play a critical role in shaping our technical strategy...
-
Senior Big Data Engineer
1 week ago
Bengaluru, Karnataka, India IT Source Global Full timeJob Title: Senior Big Data EngineerJob Description:We are seeking a highly skilled Senior Big Data Engineer to join our team at IT Source Global. As a Senior Big Data Engineer, you will be responsible for designing and implementing scalable, fault-tolerant data pipelines using Hadoop and Spark.Key Responsibilities:Design and implement data pipelines using...
-
Senior Data Pipeline Engineer
4 weeks ago
Bengaluru, Karnataka, India Squarepoint Capital Full timeAbout Squarepoint CapitalSquarepoint Capital is a global investment management firm that employs a diversified portfolio of systematic and quantitative strategies across financial markets to achieve high-quality, uncorrelated returns for our clients. We have deep expertise in trading, technology, and operations, and attribute our success to rigorous...
-
Bengaluru, Karnataka, India Conviva Apac Private Limited Full timeAt Conviva, we're the first and best place to go to understand and optimize digital customer experiences. Our Operational Data Platform harnesses full-census, comprehensive client-side telemetry-capturing every aspect of customer experience and engagement across all devices and linking them to the performance of underlying services in real time at a fraction...
-
Senior Data Architect
6 days ago
Bengaluru, Karnataka, India CareerXperts Consulting Full timeCareerXperts Consulting is a leading organization at the forefront of technological innovation, seeking an exceptional Senior Data Architect to join their team.This pivotal role will play a crucial part in shaping our technical strategy and accelerating growth within our data ecosystem. As a seasoned technical leader with a passion for building and scaling...
-
Data Pipeline Engineer
1 week ago
Bengaluru, Karnataka, India PRI Global Full timeAbout PRI GlobalPRI Global is a leading company in the field of data warehousing and ETL development.Job SummaryWe are seeking an experienced Data Pipeline Engineer to join our team. As a key member of our engineering department, you will be responsible for designing, developing, and maintaining SSIS data pipelines.Key ResponsibilitiesDesign and develop...
-
Senior Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full timeJob Description:Coders Brain Technology Private Limited is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and developing big data pipelines using AWS Databricks.About the Role:We are looking for a seasoned professional with hands-on experience in AWS Databricks, Spark, and...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India SG Analytics Pvt Limited Full timeAbout SG AnalyticsWe are SG Analytics Pvt Limited, a leading research and analytics firm that offers datacentric research and contextual analytics services to companies across various sectors.Job DescriptionThe Data Engineer will be responsible for designing, building, and testing end-to-end data pipelines, including data ingestion, integration, and...
-
Senior Time Series Data Engineer
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Senior Time Series Data Engineer to join our team in Bangalore, India. As a Senior Time Series Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems that handle complex time series data.Key ResponsibilitiesDesign and develop scalable data pipelines...
-
Bengaluru, Karnataka, India FyndBridge Consultants & Advisors Full timeWe are seeking a highly skilled Senior WebRTC and Streaming Infrastructure Architect to join our team at FyndBridge Consultants & Advisors.Job Summary:The ideal candidate will have extensive experience in designing and implementing large-scale video streaming systems using WebRTC protocols. They will be responsible for leading the development of our in-house...
