Principal Data Engineer

1 month ago

ahmedabad, India Paradise Placement Consultancy Full time

Responsibilities

Guide the Data Engineering team in development of methods and tools for data validation and analysis and in planning and execution of complex projects Focus on Quality Analytics (e.g., Mean Time between Failures, Mean Time to Crash, Mean Time to Hang, and other quality metrics) Troubleshoot complex, high risk data issues and perform root cause analysis to resolve issues Identify, design, and implement internal process improvements such as automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability Guide the building of complex ETL processes and infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources Track project data pipeline and overall data architecture stability - Monitoring the overall performance and stability of the system is important if the warehouse needs to be cleaned from time to time Prepare data for predictive and prescriptive modelling Deliver updates to stakeholders based on analytics

Stakeholder Management

Collaborate with AI Solution Managers to help allocate resources for different AI Solution projects Collaborate with Business Data Analyst, AI Champion, Solution Managers to define and ratify business solution requirements Collaborate with Data Engineers to guide the implementation of Statistical and DL Models and validate their business value Lead the functional documentation and sign off from key business stakeholders 

People Management

Build Capacity and capability for the Data Engineering function  Nurture a high-performance culture Create a highly engaged and agile team to tackle AI solution projects 

Experience, Educational Qualification and Skills

Experience:  · 12-15 years of relevant work experience

Educational Qualification:

· B.E/B.Tech and M.E./M.Tech (IT/Computer Science)
· Master’s in data science /data engineering/Information Systems
· PhD in an AI discipline (preferred)

Skills:

Mandatory

· Ability to manipulate, process and extract value from large, disconnected datasets and articulate the same in business and ML context
· Experience managing engineers and guiding them through project planning, design, development, quality control, and deployment
· Hands on knowledge on building and optimizing ‘big data’ data pipelines, architectures, and data sets from raw and unstructured data
· Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
· Strong know-how on data ingestion tools and APIs to prioritize data sources, validate them, and dispatch data to ensure an effective ingestion process.
· Knowledge on data ingestion tools such as Apache Kafka/ Apache Storm/Apache Flume/Apache Sqoop/Wavefront, and more.
· Working knowledge on data mining tools such as Apache Mahout/KNIME/Rapid Miner/Weka
· Strong know-how on ETL tools such as Talend/Informatica PowerCenter/AWS Glue/Stitch
· Ability to handle various types of data in the form of text, speech, image, video, or live stream from IoT/ Sensors/ Web
· Ability to leverage MLOps Platforms such as Teraform, Ansible, Kubeflow, Google AI Platform 

Preferred

· Basic Know-how on software development languages such as Python, Java, C++, Scala, etc
· Experience with stream-processing systems such as Storm, Spark-Streaming, etc.
· Skilled in the use of business intelligence and visualization tools, such as PowerBI, Tableau

Behavioural

· Ability to take initiative and handle concurrent tasks with appropriate priority 
· Ability to meet objectives and adhere to deadlines with minimal supervision
· Effective communication (written and oral), collaboration and technical documentation skills
· Ability to identify what resources are critical to solve a problem

Behavioural

· Strategic Orientation (PL 4)
· Entrepreneurial Mind-set (PL 3)
· Stakeholder Partnering (PL 3)
· Outcome Orientation (PL 4)
· Transformation Mind-set (PL 3)
· Innovation Focus (PL 4)
· Team Orientation (PL 3)
· Employee Development (PL 3)

People working in below domains (Preferred but not restricted to): Energy Generation (Thermal, Renewable) Transmission Distribution, City Gas Distribution Sectors, Airport, Port

and Logistics, Cyber Security, E-Commerce, FMCG, Natural Resource, Healthcare, Infrastructure, Défense

Key Skills :

Data Engineer Google Cloud Storage Google Cloud Sql Big Data Sql Aws Apache Mahout Teraform Ansible Kubeflow

  • Ea to Principal

    1 month ago

    Ahmedabad, India Global School Foundation Full time

    **Managing day-to-day transactional activities of the Principal.** **Maintain & schedule all appointments of the Principal** **Scheduling & setting up travel, meetings, calendar and other appointments for the Principal** **Organizing & maintaining files & records; collation of data as per requirements** **Preparation of weekly/ Monthly/ Annual MIS &...

  • Sr. Data Warehouse Engineer

    3 weeks ago

    ahmedabad, India Synergy Resource Solutions Full time

    Greetings from Synergy Resource Solutions, a leading HR Management Consultancy. Our client which is a US based IT company located at Ahmedabad is looking for candidates for below position: Position: Data Warehouse -Engineer   Qualification:   Bachelor's Degree in computer science or Information  Technology   Experience:  Minimum 3 years ...

  • Principal Data Engineer

    1 month ago

    Ahmedabad, India Paradise Placement Consultancy Full time

    ResponsibilitiesGuide the Data Engineering team in development of methods and tools for data validation and analysis and in planning and execution of complex projectsFocus on Quality Analytics (e.g., Mean Time between Failures, Mean Time to Crash, Mean Time to Hang, and other quality metrics)Troubleshoot complex, high risk data issues and perform root...

  • Sr. Data Warehouse Engineer

    3 weeks ago

    Ahmedabad, India Synergy Resource Solutions Full time

    Greetings from Synergy Resource Solutions, a leading HR Management Consultancy.Our client which is a US based IT company located at Ahmedabad is looking for candidates for below position:Position: Data Warehouse -EngineerQualification:Bachelor's Degree in computer science or InformationTechnologyExperience:Minimum 3 yearsLocation: AhmedabadPrincipal Duties...

  • Lead DevOps Engineer

    4 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Senior Data scientist

    1 month ago

    Ahmedabad, India Cygnet Infotech Full time

    Number of Position:1Experience:5+ years (thorough)Reports to:Principal Solutions Architect/Technical Project ManagerJob Responsibilities:Ship high-quality, well-tested, secure, and maintainable codeDesign, develop, and maintain data pipelines and back-end services for real-time decisions, reporting, optimization, data collection, and related functionsManage...

  • ▷ (Only 24h Left) Lead DevOps Engineer

    3 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Senior Data scientist

    2 months ago

    Ahmedabad, India Cygnet Infotech Full time

    Number of Position: 1Experience: 5+ years (thorough)Reports to: Principal Solutions Architect/Technical Project Manager Job Responsibilities: Ship high-quality, well-tested, secure, and maintainable codeDesign, develop, and maintain data pipelines and back-end services for real-time decisions, reporting, optimization, data collection, and related...

  • Senior Data scientist

    2 months ago

    ahmedabad, India Cygnet Infotech Full time

    Number of Position: 1 Experience: 5+ years (thorough) Reports to: Principal Solutions Architect/Technical Project Manager Job Responsibilities: Ship high-quality, well-tested, secure, and maintainable code Design, develop, and maintain data pipelines and back-end services for real-time decisions, reporting, optimization, data collection, and related...

  • Lead DevOps Engineer

    1 month ago

    Ahmedabad, India Crest Data Systems Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Lead DevOps Engineer

    1 month ago

    Ahmedabad, India Crest Data Systems Full time

    Company Overview: Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Data Engineer

    2 weeks ago

    Ahmedabad, India TIGI HR ® Full time

    Position- Data EngineerExperience-3-6 YearsBudget- 10 LPANotice period- immediate - 30 DaysLocation- AhmedabadResponsibilities:Design and build optimized data pipelines using cutting-edge technologies in a cloud environment (GCP) for analytical insights.Construct cloud infrastructure for efficient ETL processes from various sources and storage systems.Create...

  • Data Engineer

    2 weeks ago

    ahmedabad, India TIGI HR ® Full time

    Position- Data Engineer Experience-3-6 Years Budget- 10 LPA Notice period- immediate - 30 Days Location- Ahmedabad Responsibilities: Design and build optimized data pipelines using cutting-edge technologies in a cloud environment (GCP) for analytical insights. Construct cloud infrastructure for efficient ETL processes from various sources and storage...

  • Data Engineer

    2 weeks ago

    Ahmedabad, India TIGI HR ® Full time

    Position- Data EngineerExperience-3-6 YearsBudget- 10 LPANotice period- immediate - 30 DaysLocation- AhmedabadResponsibilities:Design and build optimized data pipelines using cutting-edge technologies in a cloud environment (GCP) for analytical insights.Construct cloud infrastructure for efficient ETL processes from various sources and storage systems.Create...

  • Data Engineer

    3 weeks ago

    ahmedabad, India TIGI HR ® Full time

    Position- Data EngineerExperience- 4-6 YearsBudget- 9.00LPALocation - AhmedabadNotice period- Immediate - 30 DaysRoles & Responsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure (on cloud - GCP) for efficient ETL processes from various...

  • MS Engineer

    5 days ago

    ahmedabad, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...

  • MS Engineer

    5 days ago

    Ahmedabad, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • MS Engineer

    5 days ago

    Ahmedabad, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • MS Engineer

    5 days ago

    ahmedabad, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...

  • Data Engineer

    3 weeks ago

    Ahmedabad, India TIGI HR ® Full time

    Position- Data EngineerExperience- 4-6 YearsBudget- 9.00LPALocation - AhmedabadNotice period- Immediate - 30 DaysRoles & Responsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure (on cloud - GCP) for efficient ETL processes from various...