Senior Pipeline Engineer
5 hours ago
Key Responsibilities
- Design, develop, and maintain the required platforms, plugins and extensions for 3rd party packages used in the pipeline.
- Collaborate with supervisors, technical directors, and production teams to identify new features and/or bottlenecks, and develop solutions that improve productivity and scalability.
- Automate processes and data flow between departments to streamline production workflows.
- Assist in the packaging and deployment of pipeline tools.
- Write the necessary end-user and developer documentation for developed tools
- Train and support end users on how to use the developed tools.
- Bachelor's degree or equivalent in Computer Science, Computer Visualization, or VFX required.
- 5+ years experience as a Senior Pipeline Engineer, Software Engineer, or similar role in a VFX, animation, or relevant development environment.
- Expert proficiency in Python; strong experience with other languages (e.g., C++, JavaScript) is a plus.
- Deep understanding of software development best practices: version control (Git), testing, CI/CD, containerization (Docker/Podman), and scalable system design.
- Hands-on experience with DCC applications; such as Nuke, Houdini, Maya, Unreal, and their respective scripting or expression languages (e.g. VEX, TCL) is a strong asset.
- Familiarity with production tracking tools like FPT (Autodesk Flow Production Tracking), ftrack, or similar.
- Experience with asset management systems, render farm management, industry standard review tools and automation scripting.
- Experience with standard UI/UX toolkits.
- Strong problem-solving skills and the ability to debug complex technical issues.
- Comfortable working in a Linux-based environment.
- Experience with Rez (or similar) for environment and package management.
- Knowledge of Alembic, OpenColorIO, USD (Universal Scene Description) and other open standards from the ASWF.
- Experience with web frameworks (e.g., Flask, FastAPI, Django) and database systems (PostgreSQL, Neo4j, Redis).
- Experience with performance profiling, system monitoring, and observability tools.
- Understanding of network protocols, security best practices, and compliance requirements.
- Open-source contributions or technical writing experience.
- Entrepreneurial mindset or experience working with startups or fast-paced teams.
-
Position: Data Pipeline Lead
3 days ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000Senior Data Engineer Position">We are looking for a seasoned Senior Data Engineer to join our team and lead the design, development, and maintenance of scalable data pipelines using Google Cloud Platform (GCP), BigQuery, DataProc (PySpark), and Informatica.]"The ideal candidate will have hands-on expertise in GCP, including BigQuery, DataProc, Cloud Storage,...
-
Senior Data Engineer
1 day ago
Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000Data Engineering Professional RoleWe are seeking a highly skilled Data Engineering professional to design, develop, and maintain scalable and reliable data pipelines using Google Cloud Platform (GCP) tools.
-
Senior Pipeline Design Engineer
3 days ago
Bengaluru, Karnataka, India beBeePiping Full time ₹ 9,00,000 - ₹ 12,00,000Job Description:This position will be responsible for performing engineering and consulting services for clients across the US.The main responsibilities include piping design engineering of pipeline facility design deliverables, working as a piping design engineer from conceptual phase through design completion, carrying out various piping activities and...
-
Data Pipeline Specialist
3 days ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000Job TitleSenior Data EngineerJob DescriptionAs a Senior Data Engineer, you will design, implement, and optimize data pipelines for large-scale data processing. You will work with data scientists, analysts, and engineers to ensure data availability and quality.Key responsibilities include developing and maintaining ETL/ELT workflows using Spark, Hadoop, Hive,...
-
Principal Data Pipeline Architect
7 hours ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,25,000 - US$ 1,75,000About the RoleWe are seeking a Senior Data Engineer with expertise in building scalable data pipelines and integrating healthcare data. Reporting to the Head of AI and Engineering, you will design, build, and operate the backbone of our AI-powered applications.You will work closely with software engineers, ML specialists, and clinical partners to bring our...
-
Lead Data Pipeline Specialist
7 hours ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878Job Title: Senior Data EngineerAbout the Role:This is an exceptional opportunity to join our organization as a Senior Data Engineer. As a key member of our data team, you will be responsible for designing, building, and optimizing scalable data pipelines using cloud-native technologies.Key Responsibilities:Design and architect high-throughput ETL pipelines...
-
Senior Data Pipeline Specialist
5 days ago
Bengaluru, Karnataka, India beBeeAutomatedTesting Full timeJob Opportunity:The role of Senior Consultant involves designing, developing and implementing automated test cases for complex data pipelines.Ability to design, develop, and implement automated test cases for complex data pipelines is a mustAWS experience is essentialPharma expertise is also requiredProficiency in programming languages such as Python, R, or...
-
Senior Data Engineer
2 days ago
Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000Senior Data Engineer PositionWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in designing and implementing large-scale data systems.The Senior Data Engineer will be responsible for owning end-to-end delivery of large features and systems, defining...
-
Senior Data Pipeline Developer
1 day ago
Bengaluru, Karnataka, India beBeeData Full time US$ 90,000 - US$ 1,20,000Job Description:">We are seeking a skilled and experienced Data Engineer to help build, optimize, and maintain data pipelines and architectures. The ideal candidate will have deep expertise in the Microsoft data engineering ecosystem, particularly leveraging tools such as Azure Data Factory, Databricks, Alteryx, Synapse Analytics, and a strong command of...
-
Senior Data Pipeline Specialist
18 hours ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000Job OpportunityAs a data engineer, you will play a key role in designing and implementing large-scale data pipelines using Azure Data Factory. Your expertise in ETL principles and best practices will be crucial in setting up a robust and scalable data infrastructure.Experience with building data pipelines using Azure Data Factory is essential.Proficiency in...