Data Platform Engineer 3 Days Left

2 days ago

Hyderabad, Telangana, India Amgen Inc Full time
Job Description

- Work as a member of a Data Platform Engineering team that uses Cloud and Big Data technologies to design, develop, implement and maintain solutions to support various functional areas like Manufacturing, Commercial, Research and Development.
- Collaborate with lead architect, Business SMEs, and Data Scientists to architect data solutions
- Serve as lead engineer for technical implementation of projects including planning, architecture, design, development, testing, and deployment in agile setting
- Overall management of the Enterprise Data Lake on AWS environment to ensure that the service delivery is cost effective and business SLAs around uptime, performance and capacity are met
- Help define guidelines, standards, strategies, security policies and change management policies to support the Data Lake
- Proactively work on challenging data integration problems by implementing optimal ETL patterns, frameworks for structured and unstructured data.
- Automate and Optimize data pipeline and framework for easier and cost-effective development process.
- Advice and support project teams (project managers, architects, business analysts, and developers) on cloud platforms (AWS, Databricks preferred), tools, technology, and methodology related to the design, build scalable, efficient and maintain Data Lake and other Big Data solutions
- Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies.
- Familiarity with code versioning using GITLAB, and code migration tools.
- Provide mentorship and technical guidance to junior engineers and team members.
- Stay up to date with the latest data technologies and trends

Basic Qualifications and Experience:

- Master's degree in computer science or engineering field and 1 to 3 years of relevant experience OR
- Bachelor's degree in computer science or engineering field and 3 to 5 years of relevant experience OR
- Diploma and Minimum of 8+ years of relevant work experience

Must-Have Skills:

- Experience with Databricks (or Snowflake), including cluster setup, execution, and tuning
- Experience with common data processing librariesPandas, PySpark, SQLAlchemy.
- Experience in UI frameworks (Angular.js or React.js)
- Experience with data lake, data fabric and data mesh concepts
- Experience with data modeling, performance tuning, and experience on relational databases
- Experience building ETL or ELT pipelines; Hands-on experience with SQL/NoSQL
- Program skills in one or more computer languages SQL, Python, Java
- Experienced with software engineering best-practices, including but not limited to version control (Git, GitLab.), CI/CD (GitLab, Jenkins etc.), automated unit testing, and Dev Ops
- Exposure to Jira or Jira Align.

  • 3 Days Left) Data Platforms Engineer

    4 days ago

    Hyderabad, Telangana, India S&P Global Full time

    About the Role Grade Level for internal use 09 As part of the Data Lakes and Machine Learning team the Data Engineer will focus on unlocking business value by developing data-driven solutions This role involves building and maintaining data platforms such as Databricks and Data Fabric along with data pipelines to support machine learning models and...

  • 3 Days Left Data Engineer

    1 day ago

    Hyderabad, Telangana, India ADP Full time

    Data EngineeringBelow is the JD followed for Data EngineeringPosition : Data Engineer with 4 to Y8ears experience in AWS, PySpark, Python, SQL and Data bricksLocation : Hyderabad1. In this role candidate will be responsible for understanding complex data sets, managing multiple disparate data sources, and implementing strong validation processes to ensure...

  • 3 Days Left Member Support Manager

    3 weeks ago

    Hyderabad, Telangana, India Tide Platform Full time

    ABOUT TIDEAt Tide we are building a finance platform designed to save small businesses time and money We provide our members with business accounts and related banking services but also a comprehensive set of connected administrative solutions from invoicing to accounting Launched in 2017 Tide is now used by over 1 million small businesses across the...

  • 3 Days Left: SAP BASIS ENGINEER

    4 weeks ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time

    Job DescriptionKey Responsibilities:- Ensures that assigned Packaged Application technologies such as ErP, Middleware and other business critical software in the client's environment site is configured, installed, tested, and operational.- Performs necessary checks, apply monitoring tools and respond to alerts.- Identifies problems and errors prior to or...

  • 3 Days Left Software Engineer

    3 weeks ago

    Hyderabad, Telangana, India Microsoft Full time

    Does pioneering new and innovative ways to collect and showcase key customer data sound exciting to you Are you passionate about data and do you feel we have been missing the opportunity to be more data-informed at Microsoft Do you want to contribute to an effort that is one of the most critical for the future success of Microsoft E D and SCI If so the...

  • 3 Days Left Lead Data/ai Engineering

    4 weeks ago

    Hyderabad, Telangana, India AT&T Full time

    Lead Data Engineer About AT T Chief Data Office The Chief Data Office CDO at AT T is responsible for leveraging data as a strategic asset to drive business value The team focuses on data governance data engineering artificial intelligence and advanced analytics to enhance customer experience optimize operations and enable innovation ...

  • 3 Days Left It Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Infor Full time

    Requirements A Day in The Life Typically Includes Review emails looking for open issues and priority requests Resolve any job failures Pick up next or continue current JIRA task in the analysis and delivery of data for use by other teams Work with other team members to assist and develop Develop Data models ERD Diagrams for review and execution...

  • Engineer III 3 Days Left

    3 weeks ago

    Hyderabad, Telangana, India F5 Networks Innovation Private Limited Full time

    Job DescriptionResponsibilities- Develop enterprise grade solutions for the F5 DNS products in containerized and orchestrated environments.- Aggressively grow your skillset and expertise to meet the emerging needs of our customers using our new Modular BIG-IP technology- Develop and maintain a strong CICD pipeline to efficiently diagnose and resolve critical...

  • 3 Days Left: Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Job descriptionRole: Data Engineer - Data ModellerExperience - 6+ YearsLocation: Hyderabad (Hybrid)We are looking for a Data Modeller with strong expertise in SQL, Data Modeling, and practical experience with the Power BI. Experience with Python, PySpark, or Spark is a plus. You will be responsible for designing scalable data solutions, building robust data...

  • 3 Days Left Delivery Manager

    1 day ago

    Hyderabad, Telangana, India Grid Dynamics Full time

    ExperienceL 10- 14YearsLocation : HyderabadNotice period: immediate to 30 days onlyAs a Delivery Manager you will be leading and managing a team of developers(AI Engineers, Fullstack, QA Engineers and data engineers), with a focus on building applications and platform solutions leveraging artificial intelligence (AI) and machine learning (ML)...