Data Engineering Manager
2 days ago
Design, develop, and maintain data solutions for data generation, collection, and processing.
- Lead and be hands-on for the technical design, development, testing, implementation, and support of data pipelines that load the data domains in the Enterprise Data Fabric and associated data services.
- Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems.
- Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks.
- Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs.
- Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency.
- Be able to translate data models (ontology, relational) into physical designs that are performant, maintainable, and easy to use.
- Implement data security and privacy measures to protect sensitive data.
- Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions.
- Collaborate and communicate effectively with product teams.
- Identify and resolve complex data-related challenges.
- Adhere to best practices for coding, testing, and designing reusable code/components.
- Explore new tools and technologies that will help improve ETL platform performance.
- Participate in sprint planning meetings and provide estimations on technical tasks.
- Collaborate with RunOps engineers to continuously increase our ability to push changes into production with as little manual overhead and as much speed as possible.
What we expect of you
Basic Qualifications:
- Master's degree and 4 to 6 years of Computer Science, IT, or related field experience OR
- Bachelor's degree and 6 to 8 years of Computer Science, IT, or related field experience OR
- Diploma and 10 to 12 years of Computer Science, IT, or related field experience.
Preferred Qualifications:
Functional Skills:
Must-Have Skills:
- Hands-on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, and performance tuning on big data processing.
- Proficient in SQL for extracting, transforming, and analyzing complex datasets from both relational and graph data stores (e.g., Marklogic, Allegrograph, Stardog, RDF Triplestore).
- Experience with ETL tools such as Apache Spark, Prophecy, and various Python packages related to data processing and machine learning model development.
- Strong understanding of data modeling, data warehousing, and data integration concepts.
- Able to take user requirements and develop data models for data analytics use cases.
Good-to-Have Skills:
- Knowledge of Python/R, Databricks, SageMaker, and cloud data platforms.
- Experience using graph databases such as Stardog, Marklogic, Neo4J, Allegrograph, etc., and writing SPARQL queries.
- Experience working with agile development methodologies such as Scaled Agile.
Professional Certifications:
- AWS Certified Data Engineer preferred.
- Certified Data Engineer / Data Analyst (preferred on Databricks or cloud environments).
Soft Skills:
- Excellent critical-thinking and problem-solving skills.
- Strong communication and collaboration skills.
- Demonstrated awareness of how to function in a team setting.
- Demonstrated presentation skills.
-
Azure Data Engineer
4 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Azure Data Engineer ll
4 weeks ago
Hyderabad, Telangana, India Enable Data Incorporated Full timeEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Digital Engineering Lead Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeReq ID 253253 NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad Telangana IN-TG India IN -Sr Syniti ADM...
-
Manager - Data Engineering
4 weeks ago
Hyderabad, Telangana, India HyrEzy Talent Solutions Full timeJob Description :This position requires someone with good problem solving, business understanding and client presence. Overall professional experience of the candidate should be above 8 years. A minimum of 5 years of experience in leading and managing a client portfolio in Data Engineering space. Should have good understanding of business operations,...
-
Data Engineering Manager
4 weeks ago
Hyderabad, Telangana, India Amgen Technology Private Limited Full timeJob DescriptionAs a Data Engineering Manager, you will be a strategic leader responsible for the development, optimization, and maintenance of scalable data architectures and pipelines. You will lead a team of data engineers with deep expertise in the R&D domain of the biotech/pharma industry. This role requires technical proficiency, strong leadership, and...
-
Manager, Data Engineering
3 weeks ago
Hyderabad, Telangana, India Crunchyroll Full timeJob DescriptionAbout CrunchyrollFounded by fans, Crunchyroll delivers the art and culture of anime to a passionate community. We super-serve over 100 million anime and manga fans across 200+ countries and territories, and help them connect with the stories and characters they crave. Whether that experience is online or in-person, streaming video, theatrical,...
-
Devops Engineer
2 days ago
Hyderabad, Telangana, India NTT DATA Full timeReq ID 300721NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a DevOps Engineer - Digital Solution Consultant Sr Analyst to join our team in Hyderabad Telangana IN-TG India IN ...
-
Manager – Data Engineering
3 days ago
Hyderabad, Telangana, India Cushman & Wakefield Full time US$ 1,20,000 - US$ 1,50,000 per yearJob TitleManager – Data Engineering & AnalyticsJob Description SummaryCushman & Wakefield is seeking a highly skilled Manager – Data Engineering & Analytics to lead the design, implementation, and governance of scalable, secure, and high-performing data solutions across the enterprise. Reporting to the Director of Data Engineering & Analytics, this...
-
Senior Manager Data Engineering
4 weeks ago
Hyderabad, Telangana, India Amgen Technology Private Limited Full timeJob Description- Roles & Responsibilities:Possesses strong rapid prototyping skills and can quickly translate concepts into working code.- Provide expert guidance and mentorship to the data engineering team, fostering a culture of innovation and standard methodologies.- Design, develop, and implement robust data architectures and platforms to support...
-
Sr Data Engineering Manager
2 days ago
Hyderabad, Telangana, India Amgen Inc Full timeJob DescriptionRole Description:We are seeking a SeniorData EngineeringManager with a strong background in Regulatory or Integrated Product Teams within the Biotech or Pharmaceutical domain. This role will lead the end-to-end data strategy and execution for regulatory product submissions, lifecycle management, and compliance reporting,...
