Principal Data Engineer

3 weeks ago

Ahmedabad, India Paradise Placement Consultancy Full time
Responsibilities

Guide the Data Engineering team in development of methods and tools for data validation and analysis and in planning and execution of complex projectsFocus on Quality Analytics (e.g., Mean Time between Failures, Mean Time to Crash, Mean Time to Hang, and other quality metrics)Troubleshoot complex, high risk data issues and perform root cause analysis to resolve issuesIdentify, design, and implement internal process improvements such as automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalabilityGuide the building of complex ETL processes and infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sourcesTrack project data pipeline and overall data architecture stability - Monitoring the overall performance and stability of the system is important if the warehouse needs to be cleaned from time to timePrepare data for predictive and prescriptive modellingDeliver updates to stakeholders based on analyticsStakeholder ManagementCollaborate with AI Solution Managers to help allocate resources for different AI Solution projectsCollaborate with Business Data Analyst, AI Champion, Solution Managers to define and ratify business solution requirementsCollaborate with Data Engineers to guide the implementation of Statistical and DL Models and validate their business valueLead the functional documentation and sign off from key business stakeholdersPeople ManagementBuild Capacity and capability for the Data Engineering functionNurture a high-performance cultureCreate a highly engaged and agile team to tackle AI solution projectsExperience, Educational Qualification and SkillsExperience:

· 12-15 years of relevant work experienceEducational Qualification:· B.E/B.Tech and M.E./M.Tech (IT/Computer Science)· Master’s in data science /data engineering/Information Systems· PhD in an AI discipline (preferred)Skills:Mandatory· Ability to manipulate, process and extract value from large, disconnected datasets and articulate the same in business and ML context· Experience managing engineers and guiding them through project planning, design, development, quality control, and deployment· Hands on knowledge on building and optimizing ‘big data’ data pipelines, architectures, and data sets from raw and unstructured data· Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases· Strong know-how on data ingestion tools and APIs to prioritize data sources, validate them, and dispatch data to ensure an effective ingestion process.· Knowledge on data ingestion tools such as Apache Kafka/ Apache Storm/Apache Flume/Apache Sqoop/Wavefront, and more.· Working knowledge on data mining tools such as Apache Mahout/KNIME/Rapid Miner/Weka· Strong know-how on ETL tools such as Talend/Informatica PowerCenter/AWS Glue/Stitch· Ability to handle various types of data in the form of text, speech, image, video, or live stream from IoT/ Sensors/ Web· Ability to leverage MLOps Platforms such as Teraform, Ansible, Kubeflow, Google AI PlatformPreferred· Basic Know-how on software development languages such as Python, Java, C++, Scala, etc· Experience with stream-processing systems such as Storm, Spark-Streaming, etc.· Skilled in the use of business intelligence and visualization tools, such as PowerBI, TableauBehavioural· Ability to take initiative and handle concurrent tasks with appropriate priority· Ability to meet objectives and adhere to deadlines with minimal supervision· Effective communication (written and oral), collaboration and technical documentation skills· Ability to identify what resources are critical to solve a problemBehavioural· Strategic Orientation (PL 4)· Entrepreneurial Mind-set (PL 3)· Stakeholder Partnering (PL 3)· Outcome Orientation (PL 4)· Transformation Mind-set (PL 3)· Innovation Focus (PL 4)· Team Orientation (PL 3)· Employee Development (PL 3)People working in below domains (Preferred but not restricted to): Energy Generation (Thermal, Renewable) Transmission Distribution, City Gas Distribution Sectors, Airport, Portand Logistics, Cyber Security, E-Commerce, FMCG, Natural Resource, Healthcare, Infrastructure, Défense

Key Skills :

Data EngineerGoogle Cloud StorageGoogle Cloud SqlBig DataSqlAwsApache MahoutTeraformAnsibleKubeflow

  • Ea to Principal

    6 days ago

    Ahmedabad, India Global Indian International School Pte. Ltd. Full time

    **EA to principal**: - Designation -EA To Principal - Location Jagatpur, Ahmedabad - Key Responsibilities - Managing day-to-day transactional activities of the Principal. - Maintain & schedule all appointments of the Principal - Scheduling & setting up travel, meetings, calendar and other appointments for the Principal - Organizing & maintaining files &...

  • Sr. Data Warehouse Engineer

    7 days ago

    ahmedabad, India Synergy Resource Solutions Full time

    Greetings from Synergy Resource Solutions, a leading HR Management Consultancy. Our client which is a US based IT company located at Ahmedabad is looking for candidates for below position: Position: Data Warehouse -Engineer   Qualification:   Bachelor's Degree in computer science or Information  Technology   Experience:  Minimum 3 years ...

  • Lead DevOps Engineer

    2 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Principal Data Engineer

    4 weeks ago

    ahmedabad, India Paradise Placement Consultancy Full time

    Responsibilities Guide the Data Engineering team in development of methods and tools for data validation and analysis and in planning and execution of complex projects Focus on Quality Analytics (e.g., Mean Time between Failures, Mean Time to Crash, Mean Time to Hang, and other quality metrics) Troubleshoot complex, high risk data issues and...

  • ▷ (Only 24h Left) Lead DevOps Engineer

    5 days ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Sr. Data Warehouse Engineer

    5 days ago

    Ahmedabad, India Synergy Resource Solutions Full time

    Greetings from Synergy Resource Solutions, a leading HR Management Consultancy.Our client which is a US based IT company located at Ahmedabad is looking for candidates for below position:Position: Data Warehouse -EngineerQualification:Bachelor's Degree in computer science or InformationTechnologyExperience:Minimum 3 yearsLocation: AhmedabadPrincipal Duties...

  • Senior Data scientist

    3 weeks ago

    Ahmedabad, India Cygnet Infotech Full time

    Number of Position:1Experience:5+ years (thorough)Reports to:Principal Solutions Architect/Technical Project ManagerJob Responsibilities:Ship high-quality, well-tested, secure, and maintainable codeDesign, develop, and maintain data pipelines and back-end services for real-time decisions, reporting, optimization, data collection, and related functionsManage...

  • Lead DevOps Engineer

    3 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Lead DevOps Engineer

    3 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Company Overview: Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Senior Software Engineer – Python

    3 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Job Description:We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing REST API using...

  • Senior Data scientist

    4 weeks ago

    Ahmedabad, India Cygnet Infotech Full time

    Number of Position: 1Experience: 5+ years (thorough)Reports to: Principal Solutions Architect/Technical Project Manager Job Responsibilities: Ship high-quality, well-tested, secure, and maintainable codeDesign, develop, and maintain data pipelines and back-end services for real-time decisions, reporting, optimization, data collection, and related...

  • Senior Data scientist

    4 weeks ago

    ahmedabad, India Cygnet Infotech Full time

    Number of Position: 1 Experience: 5+ years (thorough) Reports to: Principal Solutions Architect/Technical Project Manager Job Responsibilities: Ship high-quality, well-tested, secure, and maintainable code Design, develop, and maintain data pipelines and back-end services for real-time decisions, reporting, optimization, data collection, and related...

  • Senior Software Engineer – Python

    4 weeks ago

    ahmedabad, India Crest Data Systems Full time

    Job Description: We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing...

  • Senior Software Engineer – Python

    4 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Job Description: We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing REST...

  • Senior Software Engineer- AI/ML

    4 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Overview: The Senior Software Engineer for AI/ML plays a critical role in driving the technical direction and execution of artificial intelligence and machine learning projects within the organization. The SSE will collaborate closely with cross-functional teams to translate business requirements into technical designs and drive the successful...

  • Data Engineer Trainer

    6 days ago

    ahmedabad, India Helix Tech IT Services Full time

    About the Role:We are seeking a highly skilled and motivated Data Engineer Trainer to join our dynamic training team. This role is ideal for someone with a strong background in data engineering and a passion for teaching and mentorship. The Data Engineer Trainer will be responsible for developing comprehensive training modules and delivering engaging and...

  • SignGaze - Principal Full Stack Software Engineer - Frontend & Backend System

    2 weeks ago

    Ahmedabad, India SignGaze Full time

    About Us:SignGaze is at the forefront of technological innovation, constantly seeking to leverage the power of software to solve complex problems. We are a team of passionate, skilled professionals who thrive in a dynamic, fast-paced environment. Our commitment to excellence and innovation has propelled us to seek a talented Principal Full Stack Software...

  • Data Engineer Trainer

    6 days ago

    Ahmedabad, India Helix Tech IT Services Full time

    About the Role:We are seeking a highly skilled and motivated Data Engineer Trainer to join our dynamic training team. This role is ideal for someone with a strong background in data engineering and a passion for teaching and mentorship. The Data Engineer Trainer will be responsible for developing comprehensive training modules and delivering engaging and...

  • Data Engineer Trainer

    7 days ago

    Ahmedabad, India Helix Tech IT Services Full time

    About the Role: We are seeking a highly skilled and motivated Data Engineer Trainer to join our dynamic training team. This role is ideal for someone with a strong background in data engineering and a passion for teaching and mentorship. The Data Engineer Trainer will be responsible for developing comprehensive training modules and delivering engaging and...

  • Data Engineer

    7 days ago

    ahmedabad, India TIGI HR ® Full time

    Position- Data EngineerExperience- 4-6 YearsBudget- 9.00LPALocation - AhmedabadNotice period- Immediate - 30 DaysRoles & Responsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure (on cloud - GCP) for efficient ETL processes from various...