Sr Data Engineer

3 weeks ago


sany, India Talent Pal Full time
Date: 19 Apr 2024
Location:
KW
Company:
AlghanimIndustries
Long Description Job Summary
Oversee and manage various aspects of data integrationand data warehouse processes. This includes implementing dataquality measures designing and deploying integration solutionscollaborating with team members troubleshooting production issuesrefining best practices educating end users participating in codereviews exploring and adopting new technologies leading prototypedevelopment and ensuring adherence to industry standards. The roleinvolves working within Agile teams reporting on project status andpartnering with IT Solution Architects to optimize data integrationdesigns. The goal is to contribute to efficient and effective dataanalytics integration solutions while staying informed abouttechnological trends and mentoring team members.
JobResponsibilities
Operational Work 75% of time
Implement Data Warehouse data qualityprocesses. Provide solutions where issues are identified
Design develop test and deploy dataintegration solutions based on business requirements
Collaborate with team members on dataintegration designs and alternatives
Troubleshoot and resolve production issues
Continually refine and document data integration best practices
Educate end users (where applicable) in theuse of metadata and understanding where data originates
Participate in code reviews
Identify evaluate and refine leadingedge dataintegration tools and methods
Build prototypesand POCs
Bring a passion to stay on top oftech trends experiment with and learn new technologies participatein internal & external technology communities and mentorother members of the engineering community
Ownthe development of crossfunctional multiplatform prototypes
Work within and across Agile teams to designdevelop test implement and support data analytics integrationsolutions
Document and support deploymentactivities
Report on status of IT DataOperations products and projects on a regular and timely basis
Ensure the timely resolution of issues
Follow standards and guidelines according toindustry best practices
Escalate anticipatedrisks to management promptly and properly
Partner with IT Solution Architects regarding data integrationdesign options
Strategic Work 25%
Educate and inform yourself and team membersabout data integration technology solutions and emerging trends
Continually participate in visioning exercisesand contribute to the data strategy
CandidateRequirements
Required years ofrelevant experience:
4 years of experiencedesigning developing and maintaining data integration solutions
DesiredQualifications:
Education B.S. in ComputerScience or related discipline.
Advanced degreea plus
SpecializedSkills:
Required:
Data integration development experience with the following skillsets:
Extract Transformation and Load (ETL) ofdisparate data sources to targets including databases files andAPIs. Talend Matillion Glue Data Studio preferred
Ability to detect identify and resolve sourceto target performance / load issues
Expertlevel proficiency in structured query language (SQL)
o Data Warehousing
  • Thorough understanding ofrelational data models including third normal form and fact /dimension designs
  • Change data capture (CDC)design options and application
  • Datamarts
o Oracle database platform featuresincluding indexing partitioning and PL/SQL
oAWS Data Migration System (DMS) Amazon Redshift Aurora PostgresExpertise including but not limited to performance tuning
o Linux O/S commands and scripting
o Secure File Transfer Protocol (SFTP)
o Desire to work in the data integration space(data warehouse data lake AWS data APIs) while continuing to growskill sets
Desired:
Modern development practicese.g. DevOps
Experience with opensource databaseplatforms:
  • PostgreSQL
  • MySQL
  • MariaDB
Data Lake integration design and development (ETL & ELTMethodologies)
Experience with data qualitytools
Experience with AWSplatform:
o DMS
o Glue
o Redshift
o S3 etc
AWS Certifications
Experience in API development
Master datamanagement integration and concepts
Experiencewith job scheduling solutions such as Airflow
Education Bachelors Degree in Computer ScienceThis job has beensourced from an external job board.
More jobson

  • Sany, India eTek IT Services, Inc. Full time

    Role : Sr Machine LearningEngineer withAILocation :RemoteExperience:10yearsW2ContractJD:JobDescriptionTitle: Sr Engineer (Artificial Intelligence/MachineLearning) Location:Local Hybrid (3days)Duration: 12Months with potential for extension or FTEconversionKeyprojects:Starbucks exploration of generativeAIDailyResponsibilities:CodingWorking with the...

  • Sr Quality Engineer

    1 month ago


    Sany, India GOOD FIVE YES JOB CONSULTANCY Full time

    *Sr Quality Engineer* Exp: 4 8 Yrs Edu: DME/BE Package: 3LPA Loc: Ranipet Skills: Process inspectionQuality Documents Click to Apply : Qualifications and Skills Strong knowledge of precisioninstruments and process inspection Experience in inward inspection and customerquality support Proficiency in quality documentation practices Familiarity...

  • Sr Data Engineer

    2 months ago


    Sany, India RipplesIndia Group Full time

    Design new processes and builds largecomplex data flows can possess excellent analytical skills andtroubleshooting ideas aware for Agile Mode of operationsopen towork in Devops model.Responsibilities: Design new processes and buildslarge complex data flows Should possessexcellent analytical skills and troubleshooting ideasShould be aware for Agile Mode of...

  • Sr Data Engineer

    3 weeks ago


    sany, India RipplesIndia Group Full time

    Design new processes and builds largecomplex data flows can possess excellent analytical skills andtroubleshooting ideas aware for Agile Mode of operationsopen towork in Devops model.Responsibilities: Design new processes and buildslarge complex data flows Should possessexcellent analytical skills and troubleshooting ideas Should be aware for Agile Mode...


  • Sany, India Randstad India Full time

    Sr. Manager Commissioning The candidate should bepreferably a mechanical engineer with relevant experience in theindustry and able to plan and integrate all the commissioningactivities for timely completion / commissioning of the project. Heshould be able to coordinate with a group of engineers in the areasof Electrical Mechanical (Water system fire system...


  • sany, India Randstad India Full time

    Sr. Manager Commissioning The candidate should bepreferably a mechanical engineer with relevant experience in theindustry and able to plan and integrate all the commissioningactivities for timely completion / commissioning of the project. Heshould be able to coordinate with a group of engineers in the areasof Electrical Mechanical (Water system fire system...

  • Sr Data Scientist

    1 month ago


    sany, India Lufthansa Technik Services India Full time

    Rolesand Responsibilities: Successfullydeliver advanced analytics and data science projects withinpredefined timelines and budgetconstraints. Collaboration: Collaborateeffectively with data engineers and ML engineers to comprehend dataand models utilizing various advanced analyticscapabilities. SolutionDevelopment: Developefficient solutions for complex...

  • Sr Data Scientist

    1 month ago


    Sany, India Lufthansa Technik Services India Full time

    Rolesand Responsibilities:Successfullydeliver advanced analytics and data science projects withinpredefined timelines and budgetconstraints.Collaboration:Collaborateeffectively with data engineers and ML engineers to comprehend dataand models utilizing various advanced analyticscapabilities.SolutionDevelopment:Developefficient solutions for complex problems...

  • Data Engineer

    1 month ago


    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...


  • Sany, India Peppermint Robotics Full time

    About PeppermintRoboticsPeppermintis a robotics company based out of Pune (INDIA). Started in 2019 inSINE IIT Bombay Peppermint Robotics has grown into a leader incommercial cleaning robots and has its operations across 5countries. Peppermint Robotics has teams based out of its officesin Pune Bangalore Ahmedabad Dubai and Austin (TX USA) and islooking to add...

  • Sr Data Engineer

    4 weeks ago


    Sany, India Talent Pal Full time

    Date: 19 Apr 2024 Location: KW Company: AlghanimIndustries Long Description Job SummaryOversee and manage various aspects of data integrationand data warehouse processes. This includes implementing dataquality measures designing and deploying integration solutionscollaborating with team members troubleshooting production issuesrefining best practices...

  • Sr Proposal Engineer

    1 month ago


    Sany, India Randstad India Full time

    Position Name Sr . Engg Proposals RoleDescription Proposal & Estimation Engg Position DescriptionExperience Required 4 to 6 yearsQualification BE Mechanical Software knowledge 1. MSOffice 2. Working Experience on SAP/ERP etc. 3. Auto cad 4 Excel 5Drawing access Skills and Competencies 1. Shall be technicallycompetent of fabrication processes such as Welding...

  • Sr Proposal Engineer

    3 weeks ago


    sany, India Randstad India Full time

    Position Name Sr . Engg Proposals RoleDescription Proposal & Estimation Engg Position DescriptionExperience Required 4 to 6 yearsQualification BE Mechanical Software knowledge 1. MSOffice 2. Working Experience on SAP/ERP etc. 3. Auto cad 4 Excel 5Drawing access Skills and Competencies 1. Shall be technicallycompetent of fabrication processes such as Welding...

  • Data Engineer

    6 days ago


    Sany, India Expedify Full time

    OverviewExpedify.iois looking for an intelligent and detailoriented Data Engineer tojoin our ever expanding team of data engineering and analytics. Thehire will be responsible for building and optimizing our datapipeline architecture optimizing data flow and suggesting the rightset of tooling for thesame.Ourcandidate will be working directly with the senior...

  • Data engineer

    3 weeks ago


    sany, India HR Aspiration Full time

    Senior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...

  • Data Engineer

    2 months ago


    sany, India TalentPulse Consultant Full time

    Overview: The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    1 month ago


    sany, India Bista Univarsal Limited Full time

    Overview: The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities: Design andimplement scalable...

  • Python Data Engineer

    2 weeks ago


    Sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/DeveloperExp: 3 YearsRelevantLocation: PANIndiaPositions: 1Budget: 15LPANotice: Immediate joinersonlyJD:KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources.Develop manage and optimize...


  • sany, India BigShyft Full time

    AboutCompany: Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription: As a DatabricksData...


  • Sany, India BigShyft Full time

    AboutCompany:Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription:As a DatabricksData...