Sr Data Engineer

3 weeks ago


sany, India Precision Hire Solution Full time
Date: 19 Apr 2024
Location:
KW
Company:
AlghanimIndustries
Long Description Job Summary
Oversee and manage various aspects of data integrationand data warehouse processes. This includes implementing dataquality measures designing and deploying integration solutionscollaborating with team members troubleshooting production issuesrefining best practices educating end users participating in codereviews exploring and adopting new technologies leading prototypedevelopment and ensuring adherence to industry standards. The roleinvolves working within Agile teams reporting on project status andpartnering with IT Solution Architects to optimize data integrationdesigns. The goal is to contribute to efficient and effective dataanalytics integration solutions while staying informed abouttechnological trends and mentoring team members.
JobResponsibilities
Operational Work 75% of time
Implement Data Warehouse data qualityprocesses. Provide solutions where issues are identified
Design develop test and deploy dataintegration solutions based on business requirements
Collaborate with team members on dataintegration designs and alternatives
Troubleshoot and resolve production issues
Continually refine and document data integration best practices
Educate end users (where applicable) in theuse of metadata and understanding where data originates
Participate in code reviews
Identify evaluate and refine leadingedge dataintegration tools and methods
Build prototypesand POCs
Bring a passion to stay on top oftech trends experiment with and learn new technologies participatein internal & external technology communities and mentorother members of the engineering community
Ownthe development of crossfunctional multiplatform prototypes
Work within and across Agile teams to designdevelop test implement and support data analytics integrationsolutions
Document and support deploymentactivities
Report on status of IT DataOperations products and projects on a regular and timely basis
Ensure the timely resolution of issues
Follow standards and guidelines according toindustry best practices
Escalate anticipatedrisks to management promptly and properly
Partner with IT Solution Architects regarding data integrationdesign options
Strategic Work 25%
Educate and inform yourself and team membersabout data integration technology solutions and emerging trends
Continually participate in visioning exercisesand contribute to the data strategy
CandidateRequirements
Required years ofrelevant experience:
4 years of experiencedesigning developing and maintaining data integration solutions
DesiredQualifications:
Education B.S. in ComputerScience or related discipline.
Advanced degreea plus
SpecializedSkills:
Required:
Data integration development experience with the following skillsets:
Extract Transformation and Load (ETL) ofdisparate data sources to targets including databases files andAPIs. Talend Matillion Glue Data Studio preferred
Ability to detect identify and resolve sourceto target performance / load issues
Expertlevel proficiency in structured query language (SQL)
o Data Warehousing
  • Thorough understanding ofrelational data models including third normal form and fact /dimension designs
  • Change data capture (CDC)design options and application
  • Datamarts
o Oracle database platform featuresincluding indexing partitioning and PL/SQL
oAWS Data Migration System (DMS) Amazon Redshift Aurora PostgresExpertise including but not limited to performance tuning
o Linux O/S commands and scripting
o Secure File Transfer Protocol (SFTP)
o Desire to work in the data integration space(data warehouse data lake AWS data APIs) while continuing to growskill sets
Desired:
Modern development practicese.g. DevOps
Experience with opensource databaseplatforms:
  • PostgreSQL
  • MySQL
  • MariaDB
Data Lake integration design and development (ETL & ELTMethodologies)
Experience with data qualitytools
Experience with AWSplatform:
o DMS
o Glue
o Redshift
o S3 etc
AWS Certifications
Experience in API development
Master datamanagement integration and concepts
Experiencewith job scheduling solutions such as Airflow
Education Bachelors Degree in Computer ScienceThis job has beensourced from an external job board.
More jobson

  • sany, India eTek IT Services, Inc. Full time

    Role : Sr Machine LearningEngineer withAI Location :Remote Experience:10years W2Contract JD:JobDescriptionTitle: Sr Engineer (Artificial Intelligence/MachineLearning) Location:Local Hybrid (3days)Duration: 12Months with potential for extension or FTEconversionKeyprojects :Starbucks exploration of generativeAIDailyResponsibilities :CodingWorking with the...


  • sany, India eTek IT Services, Inc. Full time

    Role :Sr Machine LearningEngineer withAI Location :Remote Experience:10years W2Contract JD:JobDescriptionTitle: Sr Engineer (Artificial Intelligence/MachineLearning)Location:Local Hybrid (3days)Duration: 12Months with potential for extension or FTEconversionKeyprojects :Starbucks exploration of generativeAIDailyResponsibilities :CodingWorking with the...


  • Sany, India eTek IT Services, Inc. Full time

    Role : Sr Machine LearningEngineer withAILocation :RemoteExperience:10yearsW2ContractJD:JobDescriptionTitle: Sr Engineer (Artificial Intelligence/MachineLearning) Location:Local Hybrid (3days)Duration: 12Months with potential for extension or FTEconversionKeyprojects:Starbucks exploration of generativeAIDailyResponsibilities:CodingWorking with the...


  • Sany, India eTek IT Services, Inc. Full time

    Role : Sr Machine LearningEngineer withAILocation :RemoteExperience:10yearsW2ContractJD:JobDescriptionTitle: Sr Engineer (Artificial Intelligence/MachineLearning) Location:Local Hybrid (3days)Duration: 12Months with potential for extension or FTEconversionKeyprojects:Starbucks exploration of generativeAIDailyResponsibilities:CodingWorking with the...


  • sany, India Royal Cyber ​​Inc. Full time

    Sr.Data Engineer – Google Cloud Platform Minimum Qualification: Bachelor's degree in Computer Science or related technical field, or equivalent practical experience. Minimum 4 years of industry experience in software development, data engineering, business intelligence, data science, or related field with experience in manipulating, processing, and...

  • Sr Quality Engineer

    2 months ago


    sany, India GOOD FIVE YES JOB CONSULTANCY Full time

    *Sr Quality Engineer* Exp: 4 8 Yrs Edu: DME/BE Package: 3LPA Loc: Ranipet Skills: Process inspectionQuality Documents Click to Apply : Qualifications and Skills Strong knowledge of precisioninstruments and process inspection Experience in inward inspection and customerquality support Proficiency in quality documentation practices ...

  • Sr Quality Engineer

    2 days ago


    sany, India GOOD FIVE YES JOB CONSULTANCY Full time

    *Sr Quality Engineer* Exp: 4 8 Yrs Edu: DME/BE Package: 3LPA Loc: Ranipet Skills: Process inspectionQuality Documents Click to Apply : Qualifications and Skills Strong knowledge of precisioninstruments and process inspection Experience in inward inspection and customerquality support Proficiency in quality documentation practices ...

  • Sr Quality Engineer

    9 hours ago


    Sany, India GOOD FIVE YES JOB CONSULTANCY Full time

    *Sr Quality Engineer* Exp: 4 8 Yrs Edu: DME/BE Package: 3LPA Loc: Ranipet Skills: Process inspectionQuality Documents Click to Apply : Qualifications and Skills Strong knowledge of precisioninstruments and process inspection Experience in inward inspection and customerquality support Proficiency in quality documentation practices Familiarity...


  • Sany, India ConnectPro Consultant Full time

    DescriptionOur technology impacts how people see hear touch andengage with a wide range of IoT applications at home at work in thecar or on the go. We solve complex challengesalongside the most influential companies in the industry using themost advanced algorithms in areas such as machine learningbiometrics and video processing combined with world class...


  • Sany, India ConnectPro Consultant Full time

    DescriptionOur technology impacts how people see hear touch andengage with a wide range of IoT applications at home at work in thecar or on the go. We solve complex challengesalongside the most influential companies in the industry using themost advanced algorithms in areas such as machine learningbiometrics and video processing combined with world class...

  • Sr Data Engineer

    3 months ago


    Sany, India RipplesIndia Group Full time

    Design new processes and builds largecomplex data flows can possess excellent analytical skills andtroubleshooting ideas aware for Agile Mode of operationsopen towork in Devops model.Responsibilities: Design new processes and buildslarge complex data flows Should possessexcellent analytical skills and troubleshooting ideasShould be aware for Agile Mode of...

  • Sr Data Engineer

    2 months ago


    sany, India RipplesIndia Group Full time

    Design new processes and builds largecomplex data flows can possess excellent analytical skills andtroubleshooting ideas aware for Agile Mode of operationsopen towork in Devops model.Responsibilities: Design new processes and buildslarge complex data flows Should possessexcellent analytical skills and troubleshooting ideas Should be aware for Agile Mode...

  • Sr Java Developer

    2 weeks ago


    sany, India SPG Consulting Full time

    SR Java BS/MSdegree in Computer Science Engineering or a relatedfield solid Java developmentexperience Good knowledge of Java 8API Good knowledge of Java EE Experience with REST API s and Webapplication Security (including design andtesting) Object Oriented analysis and designusing common design patterns. Handsonexperience with major web/application servers...


  • Sany, India Randstad India Full time

    Sr. Manager Commissioning The candidate should bepreferably a mechanical engineer with relevant experience in theindustry and able to plan and integrate all the commissioningactivities for timely completion / commissioning of the project. Heshould be able to coordinate with a group of engineers in the areasof Electrical Mechanical (Water system fire system...


  • Sany, India Randstad India Full time

    Sr. Manager Commissioning The candidate should bepreferably a mechanical engineer with relevant experience in theindustry and able to plan and integrate all the commissioningactivities for timely completion / commissioning of the project. Heshould be able to coordinate with a group of engineers in the areasof Electrical Mechanical (Water system fire system...


  • sany, India Randstad India Full time

    Sr. Manager Commissioning The candidate should bepreferably a mechanical engineer with relevant experience in theindustry and able to plan and integrate all the commissioningactivities for timely completion / commissioning of the project. Heshould be able to coordinate with a group of engineers in the areasof Electrical Mechanical (Water system fire system...


  • sany, India Peppermint Robotics Full time

    About PeppermintRobotics Peppermintis a robotics company based out of Pune (INDIA). Started in 2019 inSINE IIT Bombay Peppermint Robotics has grown into a leader incommercial cleaning robots and has its operations across 5countries. Peppermint Robotics has teams based out of its officesin Pune Bangalore Ahmedabad Dubai and Austin (TX USA) and islooking to...


  • sany, India Peppermint Robotics Full time

    About PeppermintRobotics Peppermintis a robotics company based out of Pune (INDIA). Started in 2019 inSINE IIT Bombay Peppermint Robotics has grown into a leader incommercial cleaning robots and has its operations across 5countries. Peppermint Robotics has teams based out of its officesin Pune Bangalore Ahmedabad Dubai and Austin (TX USA) and islooking to...

  • Sr Proposal Engineer

    4 weeks ago


    Sany, India Randstad India Full time

    Position Name Sr . Engg Proposals RoleDescription Proposal & Estimation Engg Position DescriptionExperience Required 4 to 6 yearsQualification BE Mechanical Software knowledge 1. MSOffice 2. Working Experience on SAP/ERP etc. 3. Auto cad 4 Excel 5Drawing access Skills and Competencies 1. Shall be technicallycompetent of fabrication processes such as Welding...

  • Sr Proposal Engineer

    3 weeks ago


    sany, India Randstad India Full time

    Position Name Sr . Engg Proposals RoleDescription Proposal & Estimation Engg Position DescriptionExperience Required 4 to 6 yearsQualification BE Mechanical Software knowledge 1. MSOffice 2. Working Experience on SAP/ERP etc. 3. Auto cad 4 Excel 5Drawing access Skills and Competencies 1. Shall be technicallycompetent of fabrication processes such as Welding...