Pipeline Team
7 months ago
Summary:
VIAVI (NASDAQ: VIAV) has a 90+ year history of technical innovations that have evolved to keep pace and address our customer’s most pressing business issues. We make equipment, software, and systems that help to plan, deploy, certify, monitor, and optimize all kinds of networks - like those for mobile phones, service providers, large businesses and data centers. VIAVI is also a leader in high performance thin film optical coatings and engineered diffusers, providing light management solutions to anti-counterfeiting, consumer electronics, automotive, defense and instrumentation markets.
We are the people behind the products that help keep the world connected - at home, school, work, at play, and everywhere in between. VIAVI employees are fierce about supporting customer success and we welcome people who bring their best every day to the company - to question, to collaborate and to push for solutions that will delight our customers.
VIAVI Solutions is seeking top-flight frontend, backend, and data pipeline software development engineers to join our lively and dynamic development team creating a ground-breaking market leading solution. The team develops RAN Assurance and Automation solutions for customers around the world. The solutions are truly “Big Data”, processing and storing billions of events a day. You will join a team working on the next generation of scalable assurance systems developing a microservice architecture utilizing leading edge containerized Linux instances orchestrated by Kubernetes. The solution must be reliable as it scales to handle the extremely high data rates and offer options to flexibly manage the load and provide graceful degradation if overloaded, ensuring that it provides the best service to our customers. The team is divided into several multi-disciplinary sub-teams covering the suite of solutions organized into vertical delivery streams supporting a full CI/CD pipeline using an Agile development process.
Duties & Responsibilities:
- Duties/Responsibilities:
Design ETL (extract, transform, load) data pipelines using VIAVI’s in-house data platform-
- Produce prototypes of data pipelines for use as demos-
- Convert prototypes into horizontally scalable solutions for big-data / high-volume telecoms deploymentsCollaborate with product management and solution delivery teams to build customer-facing solutions-
- Work within R&D using a CI/CD development model to produce and validate solutions-
- Execute full software development life cycle (SDLC), including ongoing troubleshooting, maintenance, support, and enhancements for customer deploymentsPre-Requisites / Skills / Experience Requirements:
- Basic Qualifications:
BS or MS in Computer Science, Computer Engineering, Software Engineering, or related field-
- Excellent English-language written and verbal communication skills-
- 2+ or more years of software development experience, using an Agile methodology (e.g., SCRUM or Kanban), including design, development, and testing activities.-
- Experience building ETL data pipelines-
- Relational data modelling for SQL-based databases / data schema design-
- Working with a variety of data formats such as JSON, Yaml, CSV, AVRO-
- Experience working in a Linux environment (RHEL or Oracle Linux preferred) / bash scriptingPreferred Qualifications: Experience with some or all of the following:
Working knowledge of Apache Kafka-
- Working knowledge of Apache Spark-
- Performance tuning of large-scale Kafka / Spark deploymentsExperience using Kubernetes to deploy and manage resources-
- Python for solution test automation-
- GitOps approach for CI/CD-
- Atlassian tool suite, including JIRA, Confluence, Bitbucket/Git, BambooMonitoring system performance with tools such as Prometheus and Grafana-
- Strong technical communication skills
-
Pipeline Supervisor
2 days ago
Chennai, India DNEG Full timeOur Pipeline teams combine a solid understanding of technology with the workflows and processes used by our artists daily. They have a passion for supporting the creative process and for ensuring our global pipeline is as optimal as possible. As a Pipeline Supervisor, you will have overall responsibility for identifying and defining the core pipeline and...
-
Pipeline Supervisor
5 months ago
Chennai, India DNEG Full timeDescription Position at DNEG Our Pipeline teams combine a solid understanding of technology with the workflows and processes used by our artists daily. They have a passion for supporting the creative process and for ensuring our global pipeline is as optimal as possible. As a Pipeline Supervisor, you will have overall responsibility for identifying...
-
Pipeline Systems Specialist
4 weeks ago
Chennai, Tamil Nadu, India Kushi Civil Structural consultancy Pvt Ltd Full timePipeline Engineer Job OverviewWe are seeking an experienced Pipeline Engineer to join our team at Kushi Civil Structural consultancy Pvt Ltd. The successful candidate will be responsible for designing and developing pipeline systems, ensuring their integrity under pressure, temperature fluctuations, and environmental factors.Job Responsibilities:Pipeline...
-
Sr Designer
7 months ago
Chennai, India KBR Full timeTitle: Sr Designer - Pipeline The candidate shall be Min of 8-14 years of relevant Pipeline experience. FEED, detailed design, and engineering of cross country pipelines as per ASME B13.4 and ASME b31.8 & piping System in Process piping (Refineries & Chemical industries ASME B31.3) · Developing the Pipeline Alignment sheet and Route Map Based on...
-
Designer - Pipeline
3 months ago
Chennai, Tamil Nadu, India KBR Full time**Title**: Designer - Pipeline FEED, detailed design, and engineering of cross country pipelines as per ASME B13.4 and ASME b31.8 & piping System in Process piping (Refineries & Chemical industries ASME B31.3) - Developing the Pipeline Alignment sheet and Route Map Based on Survey Data. Alignment Sheet, Typical drawings, road/ river/ existing pipeline/...
-
Senior Pipeline Engineer
7 months ago
Chennai, India McDermott International Full timeCompany Overview People power our future. That is why advancing a dynamic, inclusive environment, where everyone grows and thrives is critically important to us. Our ingenuity fuels daily life. Together, we’ve forged some of the most trusted partnerships across the energy value chain to make what was once just an idea a reality: laying subsea...
-
Pipeline Td
7 months ago
Chennai, Tamil Nadu, India BOT VFX Full time**Duties & Responsibilities**: - Create global and show-based scripts and tools inside DCC packages such as Maya, Nuke and Houdini. - working directly with artists to investigate and address urgent issues related to custom pipeline tools. - Collaborate with pipeline team, software developers, CG Supervisors, vfx supervisors and artists to troubleshoot/...
-
Technical Pipeline Specialist
7 days ago
Chennai, Tamil Nadu, India Indium Full timeIndium is looking for a Technical Pipeline Specialist to join their team in Chennai. This role comes with an estimated salary of 12,00,000 INR per annum.About the RoleThe ideal candidate will have experience with Python programming and AWS services, as well as Jenkins for continuous integration. They should also be proficient in Linux environments and...
-
Data Pipeline Architect
2 weeks ago
Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full timeJob Title: Data Pipeline ArchitectColan Infotech Pvt Ltd is looking for an experienced Data Pipeline Architect to join our team in Chennai. As a Data Pipeline Architect, you will design, develop, and maintain data pipelines and data warehouses on Google Cloud Platform (GCP).About the Role:Develop data pipelines using GCP tools like Dataflow, Dataproc, and...
-
Pipeline Td
3 months ago
Chennai, Tamil Nadu, India DNEG Full timeAs a Pipeline Technical Director (Pipeline TD), you will be responsible for ensuring the smooth running of the tools, software and workflows used on our award-winning VFX and Feature Animation shows. You will be providing face-to-face technical support and assistance to artists, as well as developing new tools and scripts - predominantly in Python - to meet...
-
Pipeline Systems Specialist
1 day ago
Chennai, Tamil Nadu, India Synigence Global Services Full timeAbout Synigence Global ServicesWe are a leading provider of innovative solutions in the field of subsea pipeline engineering. Our team is dedicated to delivering high-quality services that meet the complex demands of our clients.Job DescriptionKey Responsibilities:Provide expertise in key areas of subsea pipeline engineering, ensuring adherence to industry...
-
Pipeline Atd
2 months ago
Chennai, Tamil Nadu, India DNEG Full timeAs a Pipeline Assistant Technical Director (ATD) you will perform a variety of tasks to assist the Pipeline Technical Directors (Pipeline TDs) to ensure the smooth running of the tools, software and workflows used on our award-winning VFX and Feature Animation shows. You will be working closely with the Pipeline TDs to provide face-to-face support for...
-
Data Pipeline Architect
1 week ago
Chennai, Tamil Nadu, India Engineering Services company Full time**Job Title:**We are seeking a highly skilled Data Pipeline Architect to design and implement large-scale data pipelines using Azure cloud services.The ideal candidate will have expertise in designing, developing, and maintaining scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.Key...
-
Pipeline Design and Construction Expert
4 weeks ago
Chennai, Tamil Nadu, India Kushi Civil Structural consultancy Pvt Ltd Full timePipeline Design and Construction ExpertJoin Kushi Civil Structural consultancy Pvt Ltd in Qatar as a highly skilled Pipeline Design and Construction Expert. Our team is seeking an experienced professional with expertise in pipeline design, engineering, and construction to join our Engineering department.As a Pipeline Design and Construction Expert, you will...
-
Data Pipeline Architect
4 weeks ago
Chennai, Tamil Nadu, India Walking Tree Full timeJob Title: Data Pipeline Architect">About the Role:">We are seeking an experienced ETL Test Engineer to join our team at Walking Tree. As a key member of our data engineering team, you will design, implement and continuously expand data pipelines by performing extraction, transformation, and loading activities.">Your Responsibilities:">">Gather requirements...
-
Data Pipeline Architect Lead
2 weeks ago
Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full timeJob DescriptionCynosure Corporate Solutions is looking for a highly skilled Data Pipeline Architect Lead to join our team. As a key member of our engineering team, you will be responsible for designing and implementing large-scale data pipelines using Hadoop/Spark ecosystem tools such as Sqoop, Spark, SQL, API, Hive, Oozie, Airflow, etc..About the RoleIn...
-
Senior Data Pipeline Architect
2 weeks ago
Chennai, Tamil Nadu, India Globalemployees Full timeJob Title: Senior Data Pipeline ArchitectGlobalemployees is seeking a skilled Senior Data Pipeline Architect to lead the design and implementation of our data engineering infrastructure. The successful candidate will have a strong background in data engineering and a proven track record of architecting scalable data pipelines.Data Pipeline Architecture...
-
Cloud Engineer
2 weeks ago
Chennai, Tamil Nadu, India Scoop Technologies Pvt Ltd Full timeJob OverviewScoop Technologies Pvt Ltd is seeking a skilled DevOps Engineer to join our team in Chennai. This role involves designing, implementing, and maintaining CI/CD pipelines to automate deployment and monitoring processes.Key Responsibilities- Design and implement CI/CD pipelines for automated deployment and monitoring.- Utilize GitHub Actions to...
-
Senior Data Pipeline Developer
1 month ago
Chennai, Tamil Nadu, India U-Set Consultancy Private Limited Full timeU-Set Consultancy Private Limited is seeking a skilled Senior Data Pipeline Developer to join our team. This role involves designing, executing, and maintaining test cases for ETL pipelines and data transformations. The ideal candidate will have experience working with one or more combinations of ETL tools, cloud platforms, and programming languages.Job...
-
Data Engineer for Scalable Data Pipelines
1 month ago
Chennai, Tamil Nadu, India Colan Infotech Private Limited Full timeJob DescriptionWe are seeking an experienced Data Engineer to join our team at Colan Infotech Private Limited. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines using Pyspark / Scala Spark, Databricks, Python, and SQL.The ideal candidate will have strong programming skills...