Data Platform Engineer 3 Days Left

3 weeks ago

Hyderabad, Telangana, India Amgen Inc Full time
Job Description

- Work as a member of a Data Platform Engineering team that uses Cloud and Big Data technologies to design, develop, implement and maintain solutions to support various functional areas like Manufacturing, Commercial, Research and Development.
- Collaborate with lead architect, Business SMEs, and Data Scientists to architect data solutions
- Serve as lead engineer for technical implementation of projects including planning, architecture, design, development, testing, and deployment in agile setting
- Overall management of the Enterprise Data Lake on AWS environment to ensure that the service delivery is cost effective and business SLAs around uptime, performance and capacity are met
- Help define guidelines, standards, strategies, security policies and change management policies to support the Data Lake
- Proactively work on challenging data integration problems by implementing optimal ETL patterns, frameworks for structured and unstructured data.
- Automate and Optimize data pipeline and framework for easier and cost-effective development process.
- Advice and support project teams (project managers, architects, business analysts, and developers) on cloud platforms (AWS, Databricks preferred), tools, technology, and methodology related to the design, build scalable, efficient and maintain Data Lake and other Big Data solutions
- Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies.
- Familiarity with code versioning using GITLAB, and code migration tools.
- Provide mentorship and technical guidance to junior engineers and team members.
- Stay up to date with the latest data technologies and trends

Basic Qualifications and Experience:

- Master's degree in computer science or engineering field and 1 to 3 years of relevant experience OR
- Bachelor's degree in computer science or engineering field and 3 to 5 years of relevant experience OR
- Diploma and Minimum of 8+ years of relevant work experience

Must-Have Skills:

- Experience with Databricks (or Snowflake), including cluster setup, execution, and tuning
- Experience with common data processing librariesPandas, PySpark, SQLAlchemy.
- Experience in UI frameworks (Angular.js or React.js)
- Experience with data lake, data fabric and data mesh concepts
- Experience with data modeling, performance tuning, and experience on relational databases
- Experience building ETL or ELT pipelines; Hands-on experience with SQL/NoSQL
- Program skills in one or more computer languages SQL, Python, Java
- Experienced with software engineering best-practices, including but not limited to version control (Git, GitLab.), CI/CD (GitLab, Jenkins etc.), automated unit testing, and Dev Ops
- Exposure to Jira or Jira Align.

  • 3 Days Left) Data Platforms Engineer

    4 weeks ago

    Hyderabad, Telangana, India S&P Global Full time

    About the Role Grade Level for internal use 09 As part of the Data Lakes and Machine Learning team the Data Engineer will focus on unlocking business value by developing data-driven solutions This role involves building and maintaining data platforms such as Databricks and Data Fabric along with data pipelines to support machine learning models and...

  • 3 Days Left Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India ADP Full time

    Data EngineeringBelow is the JD followed for Data EngineeringPosition : Data Engineer with 4 to Y8ears experience in AWS, PySpark, Python, SQL and Data bricksLocation : Hyderabad1. In this role candidate will be responsible for understanding complex data sets, managing multiple disparate data sources, and implementing strong validation processes to ensure...

  • 3 Days Left: Analyst, Fraud Rapid Response

    3 weeks ago

    Hyderabad, Telangana, India Tide Platform Full time

    ABOUT TIDEAt Tide we are building a finance platform designed to save small businesses time and money We provide our members with business accounts and related banking services but also a comprehensive set of connected administrative solutions from invoicing to accounting Launched in 2017 Tide is now used by over 1 million small businesses across the...

  • 3 Days Left) Process Mining Platform Engineer

    3 weeks ago

    Hyderabad, Telangana, India Pepsico Full time

    OverviewAs a process mining platform engineer you will be responsible for catering to devsecops requirements from sector teams on the platform. Resolving platform incidents and fulfilling the service requests. This role will also involve platform engineering activities on ETL, administration and enabling of new capabilities on the...

  • 3 Days Left Engineering Manager

    3 weeks ago

    Hyderabad, Telangana, India Procter & Gamble Full time

    Job Location HYDERABAD OFFICE INDIA We re looking for an Engineering Manager to join our Data Analytics Core Data Lake Platform engineering team We are searching for self-motivated candidates who will demonstrate modern Agile and DevOps practices to design develop test and deploy IT systems and applications delivering global projects in...

  • 3 Days Left Azure Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Enterprise Minds, Inc Full time

    Job DescriptionWe&aposre Hiring | Data EngineerWere looking for an experienced Data Engineer Consultant to join our growing team for an exciting Greenfield S/4HANA Implementation projectRole: Data EngineerLocation: HybridExperience: 3-5 yearsKey Skills:1. Data Pipeline Development: Design, build, and maintain ETL/ELT pipelines using Azure Data Factory...

  • 3 Days Left Power Platform Engineer

    3 weeks ago

    Hyderabad, Telangana, India Pepsico Full time

    OverviewThis role should be able to propose solutions to solve business problems within Power Platform tools.This role would require Technical Expertise in Power Apps and Power Automation Tools with hands on experience in building solutions using Power Pages, Power Flow, SharePoint DB and Dataverse.Responsibilities- Work with business teams to understand the...

  • 3 Days Left: Data Architect

    2 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: Data ArchitectRequired Technical Skill Set: AWS, Azure, GCP, Snowflake, Redshift, BiqQuery, Python, Talend, IICS, Hadoop, Spark, Kafka, Databricks.Desired Experience Range: 10-15 YearsLocation of Requirement: Hyderabad / Pune/Bangalore/Delhi / MumbaiDesired Competencies (Technical/Behavioral Competency)Must-Have1. 8+ years of experience and played the...

  • 3 Days Left Delivery Manager

    3 weeks ago

    Hyderabad, Telangana, India Grid Dynamics Full time

    ExperienceL 10- 14YearsLocation : HyderabadNotice period: immediate to 30 days onlyAs a Delivery Manager you will be leading and managing a team of developers(AI Engineers, Fullstack, QA Engineers and data engineers), with a focus on building applications and platform solutions leveraging artificial intelligence (AI) and machine learning (ML)...

  • Data Platform Engineer

    2 weeks ago

    Hyderabad, Telangana, India INFOSLAB CONSULTANCY PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Data Platform Engineer We are hiring Data Platform Engineers for our Hyderabad Office (Hybrid Mode). Role: Data Platform Engineer | . Loc.: Hyderabad. Work Mode: Hybrid (3 days a week). 6 to 8 years of exp.. immediate joiner. For a Healthcare Data Analytics client. Must Have Hands-on SkillsProficient with Python Programming, Scala, SQL, RedshiftAWS :...