Sr. Data Engineer

2 weeks ago

Delhi, India MDMS Recruiting LLC Full time
Job Description***W2 or Self Inc. Only | this is not open to subcontracting (no C2C)***Senior Data Engineer to help the design/build of the enterprise data platformsDesign, Develop and Implement

End-to-end data solutions (ingest, storage, integration, processing, access) on AWS.

Data intake/ request/ onboarding services and service documentation.

Data ingestion services for batch/ real time data ingest and service documentation.

Data processing services for batch/ real time (Glue/ Kinesis/ EMR) and service documentation.

Data storage services for data lake (S3)/ data warehouses (RDS/ Redshift)/ data marts and service documentation.

Data services layer including Athena, Redshift, RDS, microservices and APIs.

Pipeline orchestration services including lambda, step functions, MWAA (optional).

Data security services (IAM/ KMS/ SM/ encryption/ anonymization/ RBAC) and service documentation.

Data access provisioning services (Accounts, IAM Roles RBAC), processes, documentation and education.

Data provisioning services for data consumption patterns including microservices, APIs and extracts.

Metadata capture and catalog services for data lake (S3/ Athena), data warehouses (RDS/ Redshift), Microservices/ APIs.

Metadata capture and catalog services for pipeline/ log data for monitoring / support.

Architect and implement CI/ CD strategy for EDP .

Implement high velocity streaming solutions using Amazon Kinesis, SQS, and SMS.

Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift.

Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.

Implement cost/ spend monitoring for AWS based data platform.

Implement audit reporting for access of AWS based data platform.

Contribute to the implementation of a data strategy to enable a robust, holistic view of data - driven decision making.

Partner with immediate engineering team, product owner, IT, partners on EDP agenda.

Leverage and continuously develop best practices, standards, and frameworks.

Provide technology thought leadership, consulting, and coaching/ mentoring.

Work with scrum master to develop and own backlog, stories, epics, sprints.

System design and Architecture for products/ applications for EDP.

Work closely with various stakeholders (BI, AIML, MDM and other teams) to understand their use-cases and design optimal solution for them.

Execute technical design and infrastructure strategy for EDP .

Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case.

Qualifications

Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience.

Experience implementing, supporting data platforms on AWS for large enterprises.

Full stack development experience building secure internal facing applications.

Programming experience with Java, Python/ Scala, Shell scripting.

Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/ Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.

Solid experience implementing solutions on AWS based data lakes preferred.

Experience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDB.

AWS Solutions Architect or AWS Big Data Certification preferred.

Experience in AWS data lake, data warehouse and business analytics.

Experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR/Spark, Glue, Datasync, CloudHealth, CloudWatch, Lambda, Athena, and Redshift.

Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.

Experience with DevOps and Continuous Integration/ Delivery (CI/ CD) concepts and tools.

Experience with business intelligence tools such as Tableau, Power BI or equivalent.

Knowledge of ETL/ ELT.

Awareness of Data Management & Governance tools.

Working experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desired.

Experience working on Agile projects.

Requirementsdata engineering, AWS, data lake / data warehouses

  • Engineer / Sr. Engineer / Asst. Manager | Officer / Sr. Officer - Raw Materials

    3 weeks ago

    new delhi, India UltraTech Cement Full time

    Location - Awarpur Cement works (Chandrapur, Maharashtra, India)Designation - Engineer / Sr. Engineer / Asst. Manager | Officer / Sr. OfficerEducational Qualification - BE/ B. Tech in any stream GraduateWork Experience - 4 to 6yrsPreferred Skills - Purchase of raw materials (Coal / Fly Ash / Gypsum) | Cement / Coal / Power industry experienceJOB...

  • Sr Software Engineer

    4 weeks ago

    Delhi, India Deltek Full time

    16-Apr-2024Sr Software EngineerIndia-Remote9263BRCompany SummaryAs the recognized global standard for project-based businesses, Deltek delivers software and information solutions to help organizations achieve their purpose. Our market leadership stems from the work of our diverse employees who are united by a passion for learning, growing and making a...

  • Senior Data Engineer

    4 weeks ago

    Delhi, India SMC Squared India Full time

    ESSENTIAL RESPONSIBILITIES• Implement various data platform functionalities and structures using Microsoft Azure PaaS offerings e.g. Azure Data Factory, Databricks, Logic Apps, Functions, Event Hubs, and various storage offerings.• Lead cross-functional technical discussions that drive decisions and actionable implementation approaches• Design...

  • Senior Data Engineer

    4 weeks ago

    Delhi, India SMC Squared India Full time

    ESSENTIAL RESPONSIBILITIES Implement various data platform functionalities and structures using Microsoft Azure PaaS offerings e.G. Azure Data Factory, Databricks, Logic Apps, Functions, Event Hubs, and various storage offerings. Lead cross-functional technical discussions that drive decisions and actionable implementation approaches Design conceptual,...

  • Senior Data Engineer

    4 weeks ago

    Delhi, India SMC Squared India Full time

    ESSENTIAL RESPONSIBILITIES• Implement various data platform functionalities and structures using Microsoft Azure PaaS offerings e.g. Azure Data Factory, Databricks, Logic Apps, Functions, Event Hubs, and various storage offerings.• Lead cross-functional technical discussions that drive decisions and actionable implementation approaches• Design...

  • Sr. Data Engineer

    2 weeks ago

    Delhi, India Arting Digital Private Limited Full time

    Job DescriptionSr. Data EngineerExperience: 6y+Location: Trivandrum, Chennai, Pune, BangaloreBudget: 15 LPAWork Mode: On-SiteSkills:Ataccama, Syndigo, Snowflake, DatabricksRequirements:6+ Yrs experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutionsProgramming experience in Scala or Python, SQLMin 1+ years...

  • Principal Sr/Engineer

    3 days ago

    Delhi, India Photon Full time

    Job description:-The Principal/Sr engineer, reporting to the Sr Manager, Flagship Mobile Apps, will work on the team that brings CVS customers their “Super app” – the customer-facing Flagship CVS Shopping and Pharmacy apps.As a Principal/Sr Engineer, you will be helping advance our architecture and Mobile Product, working with cross-functional teams...

  • Principal Data Engineer

    4 weeks ago

    Delhi, India Cornerstone OnDemand Full time

    We're looking for aPrincipal Data EngineerThis role isRemotePrincipal Data EngineerWe are seeking a talented Principal Data Engineer in Pune, India. Reporting to the Sr. Manager – Data Engineering. The right candidate has strong communication skills, passion for solving business problems with data, domain knowledge in Finance – O2C, FP&A or Human...

  • Python with Data Bricks

    1 month ago

    Delhi, India Nityo Infotech Full time

    16 hours ago **Job Code**: JD-19728 **JOB DESCRIPTION**: Job Title: Sr. Software Engineer - Python We are looking forward to hire Python Professionals in the following areas : Experience - 4-6 Years Job description - We are looking for a Python Developer to join our engineering team and help us develop and maintain various software products. - The...

  • Sr. Software Engineer II

    4 weeks ago

    Delhi, India Bottomline Full time

    RoleWe are looking for aSr. Software Engineer IIto innovate, win and grow with us inBangalore!TheSr. Software Engineer IIis involved in all stages of development including planning, implementation, testing, documentation, release and product support; work to debug and implement new changes to systems as they are prioritized. He/she must have good...

  • Sr. Fullstack Engineer

    4 weeks ago

    Delhi, India SolutionSavvy Full time

    Full stack DeveloperJr. Developer - Salary Range 2.5 LPA - 4 LPA (negotiable)Mid Sr. Developer - Salary Range 4 LPA- 10 LPA (negotiable)Sr. Developer - Salary Range 10LPA - 15 LPA (negotiable)Architect Level - 15 LPA - 20 LPAWe are a start-up building custom products for our clients. Currently, we are working with German clients to build an end-end product...

  • Sr Backend Engineer

    4 weeks ago

    Delhi, India Egnyte Full time

    DescriptionSr Backend EngineerEGNYTE YOUR CAREER. SPARK YOUR PASSION.Egnyte is a place where we spark opportunities for amazing people. We believe that every role has meaning, and every Egnyter should be respected. With over 22,000 customers worldwide and growing, you can make an impact by protecting their valuable data. When joining Egnyte, you’re not...

  • Sr Data Consultant/Architect

    3 weeks ago

    Delhi, India NEXUS CORPORATION Full time

    Job DescriptionWe are seeking a Sr Data Consultant/Architect to join our Japan team in Tokyo. As a Sr Data Consultant you will be accountable for developing data products with decentralized data architecture. You will be able to apply your data warehousing experience as well as learn modern and efficient ways of delivering data to business partners. You will...

  • :Data Analyst

    1 month ago

    new delhi, India White Force Full time

    Job Description: Position Title:Data Analyst / Sr. Data Analyst Department:Engagement Reports To:Aditya Temporary: Permanent: Permanent Pay scale:35-40k / month Location: Delhi Date Needed: ASAP Position Summary: Prepare daily / weekly / monthly report in excel. Prepare weekly / Monthly PPT. Dialer / Real Time Knowledge. Data management / Google...

  • Sr Software Developer

    7 days ago

    Delhi, Delhi, India timesjobs Full time

    JOB DETAILS1 Develop and support our proprietary platforms and products2 Follow, support and enhance the team code standards and development strategy3 Assist in customer support queries when escalated by the client facing teams4 Introduce new tools and technologies to assist with data processing and analysis5 Mentoring and development of junior team members6...

  • Sr Software Developer

    7 days ago

    Delhi, India timesjobs Full time

    JOB DETAILS1 Develop and support our proprietary platforms and products2 Follow, support and enhance the team code standards and development strategy3 Assist in customer support queries when escalated by the client facing teams4 Introduce new tools and technologies to assist with data processing and analysis5 Mentoring and development of junior team members6...

  • Sr Quality Engineer

    4 weeks ago

    Delhi, India GOOD FIVE YES JOB CONSULTANCY Full time

    *Sr Quality Engineer*Exp: 4 - 8 Yrs |Edu: DME/BEPackage: 3 LPA | Loc: RanipetSkills: Process inspection, Quality to Apply :Qualifications and SkillsStrong knowledge of precision instruments and process inspectionExperience in inward inspection and customer quality supportProficiency in quality documentation practicesFamiliarity with cold roll forming...

  • Senior Azure Data Engineer

    3 weeks ago

    Delhi, India YASH Technologies Full time

    Sr. Software Engineer - AzureExperience: 4 - 7 years of ExperienceWhat you should have?Azure Data Factory, Azure DevOps CI/CD, Azure Data Lake, Azure Synapse, Azure Databricks, PySpark, GitHub.Need 4+ Years of experience Good analytical skills with excellent knowledge of SQL.Well versed with Azure ServicesMust have experience and knowledge on ADF, ADLS, Blob...

  • Senior Data Engineer

    1 week ago

    delhi, India AMINA Bank Full time

    About AMINAAMINA India is a wholly owned subsidiary of AMINA Bank AG, a licensed Swiss Bank focused on cryptocurrencies and digital assets. AMINA provides custody, trading, credit and investment products on cryptocurrencies and digital assets to institutional and professional investors. AMINA Bank is Headquartered in Zug, with presence in Mumbai, Abu Dhabi,...

  • Data Vault

    3 days ago

    delhi, India NexionPro Services Full time

    Position: Data Vault Engineer/Sr. EngineerLocation: Bangalore/Hyd/Chennai/Pune/GurgaonWork Mode: HybridPlease find the below JD :Experience: 5+ yearsRelevant in Data Vault : 5+ yearsMandatory Skills: Data Vault 2:0, Data Modeling, Snowflake, SQL.§ Strong exp into Data Vault 2.0§ Strong Knowledge of relational databases, cloud data warehouses - Snowflake is...