Principal Data Engineer

1 week ago

Ahmedabad, Gujarat, India Paradise Placement Consultancy Full time
Responsibilities

Guide the Data Engineering team in development of methods and tools for data validation and analysis and in planning and execution of complex projectsFocus on Quality Analytics (e.g.

, Mean Time between Failures, Mean Time to Crash, Mean Time to Hang, and other quality metrics)Troubleshoot complex, high risk data issues and perform root cause analysis to resolve issuesIdentify, design, and implement internal process improvements such as automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalabilityGuide the building of complex ETL processes and infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sourcesTrack project data pipeline and overall data architecture stability - Monitoring the overall performance and stability of the system is important if the warehouse needs to be cleaned from time to timePrepare data for predictive and prescriptive modellingDeliver updates to stakeholders based on analyticsStakeholder ManagementCollaborate with AI Solution Managers to help allocate resources for different AI Solution projectsCollaborate with Business Data Analyst, AI Champion, Solution Managers to define and ratify business solution requirementsCollaborate with Data Engineers to guide the implementation of Statistical and DL Models and validate their business valueLead the functional documentation and sign off from key business stakeholdersPeople ManagementBuild Capacity and capability for the Data Engineering functionNurture a high-performance cultureCreate a highly engaged and agile team to tackle AI solution projectsExperience, Educational Qualification and SkillsExperience:

  • 12-15 years of relevant work experience

Educational Qualification:

  • B.E/B.Tech and M.E./M.Tech (IT/Computer Science)
  • Master's in data science /data engineering/Information Systems
  • PhD in an AI discipline (preferred)

Skills:
Mandatory
  • Ability to manipulate, process and extract value from large, disconnected datasets and articulate the same in business and ML context
  • Experience managing engineers and guiding them through project planning, design, development, quality control, and deployment
  • Hands on knowledge on building and optimizing 'big data' data pipelines, architectures, and data sets from raw and unstructured data
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
  • Strong know-how on data ingestion tools and APIs to prioritize data sources, validate them, and dispatch data to ensure an effective ingestion process.
  • Knowledge on data ingestion tools such as Apache Kafka/ Apache Storm/Apache Flume/Apache Sqoop/Wavefront, and more.
  • Working knowledge on data mining tools such as Apache Mahout/KNIME/Rapid Miner/Weka
  • Strong know-how on ETL tools such as Talend/Informatica PowerCenter/AWS Glue/Stitch
  • Ability to handle various types of data in the form of text, speech, image, video, or live stream from IoT/ Sensors/ Web
  • Ability to leverage MLOps Platforms such as Teraform, Ansible, Kubeflow, Google AI PlatformPreferred
  • Basic Know-how on software development languages such as Python, Java, C++, Scala, etc
  • Experience with stream-processing systems such as Storm, Spark-Streaming, etc.
  • Skilled in the use of business intelligence and visualization tools, such as PowerBI, TableauBehavioural
  • Ability to take initiative and handle concurrent tasks with appropriate priority
  • Ability to meet objectives and adhere to deadlines with minimal supervision
  • Effective communication (written and oral), collaboration and technical documentation skills
  • Ability to identify what resources are critical to solve a problemBehavioural
  • Strategic Orientation (PL 4)
  • Entrepreneurial Mind-set (PL 3)
  • Stakeholder Partnering (PL 3)
  • Outcome Orientation (PL 4)
  • Transformation Mind-set (PL 3)
  • Innovation Focus (PL 4)
  • Team Orientation (PL 3)
  • Employee Development (PL 3)
People working in below domains (Preferred but not restricted to):
Energy Generation (Thermal, Renewable) Transmission Distribution, City Gas Distribution Sectors, Airport, Portand Logistics, Cyber Security, E-Commerce, FMCG, Natural Resource, Healthcare, Infrastructure, Défense

Key Skills :
Data EngineerGoogle Cloud StorageGoogle Cloud SqlBig DataSqlAwsApache MahoutTeraformAnsibleKubeflow

  • Ea to Principal

    1 week ago

    Ahmedabad, Gujarat, India Global Indian International School Pte. Ltd. Full time

    EA to principal: Designation EA To Principal Location Jagatpur, Ahmedabad Key Responsibilities Managing daytoday transactional activities of the Principal. Maintain & schedule all appointments of the Principal Scheduling & setting up travel, meetings, calendar and other appointments for the Principal Organizing & maintaining files & records; collation of...

  • Sr. Data Warehouse Engineer

    1 week ago

    Ahmedabad, Gujarat, India Synergy Resource Solutions Full time

    Greetings from Synergy Resource Solutions, a leading HR Management Consultancy.Our client which is a US based IT company located at Ahmedabad is looking for candidates for below position:Position: Data Warehouse -Engineer Qualification: Bachelor's Degree in computer science or Information Technology Experience: Minimum 3 years Location: Ahmedabad Principal...

  • Senior Data scientist

    1 week ago

    Ahmedabad, Gujarat, India Cygnet Infotech Full time

    Number of Position:1Experience:5+ years (thorough)Reports to:Principal Solutions Architect/Technical Project ManagerJob Responsibilities:Ship high-quality, well-tested, secure, and maintainable codeDesign, develop, and maintain data pipelines and back-end services for real-time decisions, reporting, optimization, data collection, and related functionsManage...

  • Senior Data scientist

    1 week ago

    Ahmedabad, Gujarat, India Cygnet Infotech Full time

    Number of Position: 1 Experience: 5+ years (thorough) Reports to: Principal Solutions Architect/Technical Project Manager Job Responsibilities: Ship high-quality, well-tested, secure, and maintainable code Design, develop, and maintain data pipelines and back-end services for real-time decisions, reporting, optimization, data collection, and related...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Talentoj Full time

    Azure Data Engineer : We are seeking a highly skilled Azure Data Engineer to join the data engineering team and play a crucial role in an optimization initiative. The current problem is that read speed is compromised and faster responses from delta are required.The ideal candidate should have extensive experience in Python programming and be proficient in...

  • Principal ASIC Design

    1 week ago

    Ahmedabad, Gujarat, India Infinera Full time

    : Principal Engineer (M)Role:In this role, you will be responsible for the verification of a large complex block or multiple blocks. You will work with a team of verificaiton engineers to deliver bug free ASIC.What you will be doing:Work closely with peers in architecture, design, verification, emulation, SDK, Hardware teams and project team membersEstimate...

  • Senior DevOps Engineer

    1 week ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad & Pune Key...

  • MS Engineer

    1 week ago

    Ahmedabad, Gujarat, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Kraft Heinz Full time

    Data Engineer: Work from Office: Ahmedabad Description & Requirements: About the Position We have an excellent opportunity available for an Associate Data Engineer to make a difference at Kraft Heinz.The Associate Data Engineer role lies within the newly created Analytics Centre of Excellence within the Global Business Services organization.The Analytics COE...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Kraft Heinz Full time

    Data Engineer: Work from Office: AhmedabadDescription & Requirements:About the PositionWe have an excellent opportunity available for an Associate Data Engineer to make a difference at Kraft Heinz. The Associate Data Engineer role lies within the newly created Analytics Centre of Excellence within the Global Business Services organization. The Analytics COE...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Sterlite Technologies Limited Full time

    Role as a Data engineer :Develop and build AI/ML model ready data ponds using Azure Databricks Delta lake Improve upon the data ingestion models, ETL jobs, and alarm to maintain data integrity and data availability. Partner with AI/ML product teams proactively identify the data needs for rapid experimentation, stable production deployment and ensure the...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Kraft Heinz Full time

    Data Engineer: Work from Office: AhmedabadDescription & Requirements:About the PositionWe have an excellent opportunity available for an Associate Data Engineer to make a difference at Kraft Heinz. The Associate Data Engineer role lies within the newly created Analytics Centre of Excellence within the Global Business Services organization. The Analytics COE...

  • Principal ASIC Design

    1 week ago

    Ahmedabad, Gujarat, India Infinera Full time

    Description : Principal Engineer (M) Role: In this role, you will be responsible for the verification of a large complex block or multiple blocks. You will work with a team of verificaiton engineers to deliver bug free ASIC. What you will be doing: Work closely with peers in architecture, design, verification, emulation, SDK, Hardware teams and...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Paradise Placement Consultancy Full time

    Responsibilities development of methods and tools for data validation and analysis and in planning and execution of complex projects Focus on Quality Analytics (e.g., Mean Time between Failures, Mean Time to Crash, Mean Time to Hang, and other quality metrics) Troubleshoot complex, high risk data issues and perform root cause analysis to resolve...

  • Principal Asic Design

    1 week ago

    Ahmedabad, Gujarat, India Infinera Full time

    Job Description: Principal Engineer (M)Role:In this role, you will be responsible for the verification of a large complex block or multiple blocks. You will work with a team of verificaiton engineers to deliver bug free ASIC.What you will be doing: Work closely with peers in architecture, design, verification, emulation, SDK, Hardware teams and project team...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India TIGI HR ® Full time

    Position- Data Engineer Experience- 4-6 Years Budget- 9.00LPA Location - Ahmedabad Notice period- Immediate - 30 Days Roles & Responsibilities: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.  Constructing infrastructure (on cloud - GCP) for efficient ETL processes...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Acesoft Labs (India) Pvt Ltd Full time

    We are looking for a talented Data Engineer to join our team at XYZ Company!Responsibilities:Build efficient data pipelines for training examples and online trainingDesign and implement data transformations for various purposesCreate scalable big data systems to support our core productsIdentify opportunities for application improvementsManage project...

  • Senior Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Ridgeant Techonologies Full time

    Job Description : AWS Data EngineerResponsibilities : Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services. Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...

  • Data Architect

    2 months ago

    Ahmedabad, Gujarat, India Headsup Corporation Pvt. Ltd. Full time

    As a Data Architect, you will be the driving force behind our data strategy. You will be responsible for designing and implementing a robust and scalable data architecture, collaborating with cross-functional teams, and ensuring that our data infrastructure supports the company's growth and analytical needs.Skills : 1. Proven experience in data...

  • Data Architect

    4 weeks ago

    Ahmedabad, Gujarat, India Headsup Corporation Pvt. Ltd. Full time

    As a Data Architect, you will be the driving force behind our data strategy. You will be responsible for designing and implementing a robust and scalable data architecture, collaborating with cross-functional teams, and ensuring that our data infrastructure supports the company's growth and analytical needs.Skills : 1. Proven experience in data...