Data Engineer mfd

1 month ago


New Delhi, India Codepan GmbH Full time

Codepan founded in 2014 is a Berlinbased AIInnovation Hub. Our team of passionate data scientists engineersand technologists applies machine learning to solve realworldproblems for clients as well as to incubate and accelerate our ownAI product ideas.

Codepan is currentlydeveloping an AIbased product using capabilities of stateoftheartLLM technologies in the space of Intelligent Documentprocessing.

Tasks

As a DataEngineer in our team youll architect build and maintain advanceddata pipelines and storage solutions. Youll play a pivotal role inenabling our analytics and AI teams to work efficiently with largedatasets including those used for training and deploying LargeLanguage Models (LLMs) and RetrievalAugmented Generation (RAG)models.

KeyResponsibilities:

  • Designand optimize scalable data pipelines to support advanced analyticsmachine learning and AI projects with a particular focus onapplications involving LLMs and RAGs.
  • Developrobust data warehousing solutions that ensure fast reliable accessto large volumes of data optimizing for query performance andsystem scalability.
  • Collaborate with AIresearch and development teams to understand data requirements andensure the seamless integration of AI models with our dataecosystem.
  • Implement data governance andsecurity measures adhering to best practices and regulatorystandards to safeguard sensitiveinformation.
  • Utilize and advocate forcloudbased technologies and services to enhance our data processingcapabilities ensuring our infrastructure is both flexible andcosteffective.
  • Regularly evaluate and adopt newtools and technologies to keep our data infrastructure at theforefront of industry standards particularly those enhancing LLMand RAG functionalities.
  • Simplify complex dataflows making data easily accessible for nontechnical stakeholderswhile maintaining the integrity and confidentiality of thedata.
Requirements
  • Bachelorsor Masters degree in Computer Science Engineering InformationSystems or a related field.
  • At least 5 years ofproven experience in data engineering with a track record ofdeveloping scalable data solutions.
  • Strongtechnical expertise in SQL/NoSQL databases Python Java and ETLprocesses.
  • Experience with cloud platforms(Azure/GCP) and familiarity with big datatechnologies.
  • A keen interest in AItechnologies especially LLMs and RAG models with a desire to stayupdated on the latest trends andtechniques.
  • Solid foundation in data securityprinciples and a commitment to implementing privacycompliant datamanagement practices.
  • Excellent problemsolvingskills ability to work collaboratively in a team environment andstrong communication skills for explaining complex technicalconcepts.

Join us to contribute tocuttingedge projects in AI and analytics leveraging your expertiseto create impactful data solutions.

Salary: 30L35L remote job in India


  • Data Engineer

    2 weeks ago


    New Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position, you should...

  • Data Engineer

    3 weeks ago


    New Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should...

  • Data Engineer

    2 weeks ago


    new delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should...

  • Data Engineer

    1 week ago


    New Delhi, India Terminus Full time

    Role We are looking for a Data Engineer to join our team who will be involved data management and transformation at scale and optimize to prepare the data pipe for the AI /Analytical technology stack. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The...

  • Data Engineer

    10 hours ago


    New Delhi, India Uplers Full time

    Uplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through robust technical skill assessments tailored to specific roles. Uplers seamlessly...

  • Data Engineer

    2 days ago


    New Delhi, India Uplers Full time

    Uplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through robust technical skill assessments tailored to specific roles. Uplers seamlessly...


  • New Delhi, India Woolworths Group International Full time

    What we're likeAt BIG W every day's a big day. For you, this could be the start of something big.There are over 15,000 of us, in the biggest cities and the tiniest towns. And each of us has an important role to play to help make a real difference for families by providing real value, real solutions and real care.If you have a passion for designing and...

  • Head Of Data Engineer

    34 minutes ago


    new delhi, India MASAN Group Full time

    Responsibilities:1. Data Strategy and GovernanceDevelop and implement the data strategy and roadmap aligned with the organisation's overall business goals and objectivesDefine data governance policies and procedures to ensure data quality, security, and regulatory complianceEstablish data standards, best practices, and guidelines to promote consistent and...

  • Data Engineer

    1 week ago


    new delhi, India Tata Technologies Full time

    Position :- Data Engineer (Snowflake)Location :- PuneExp. Rane :- 4-6 yearsMust Have:4-6 Years Overall experience4+ years of experience with sound knowledge on database concepts like Entity-relationship, Data modeling, DDL and DML statements etc.3+ years of proven experience in Snowflake in data modelling, data pipelines, data governance and performance...

  • Head Of Data Engineer

    11 hours ago


    New Delhi, India MASAN Group Full time

    Responsibilities:1. Data Strategy and GovernanceDevelop and implement the data strategy and roadmap aligned with the organisation's overall business goals and objectivesDefine data governance policies and procedures to ensure data quality, security, and regulatory complianceEstablish data standards, best practices, and guidelines to promote consistent and...

  • Head Of Data Engineer

    17 hours ago


    new delhi, India MASAN Group Full time

    Responsibilities: 1. Data Strategy and Governance Develop and implement the data strategy and roadmap aligned with the organisation's overall business goals and objectives Define data governance policies and procedures to ensure data quality, security, and regulatory compliance Establish data standards, best practices, and guidelines to promote consistent...


  • new delhi, India Narwal Full time

    About Us:Narwal, with its Global Delivery Model, strategically expands its reach across North America, the United Kingdom, and an offshore development centre in India. Delivery cutting edge AI, Data, Cloud and Quality Engineering solutions and consistently surpassing expectations, Narwal has achieved remarkable triple-digit growth rates year after year,...

  • Data Engineer

    2 weeks ago


    New Delhi, India Blackstraw.ai Full time

    Data Engineer Company Name: Blackstraw.ai Office Location: Delhi (Work from Office) Job Type: Full-time Experience: 4+ Years Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall,...


  • new delhi, India Fractal Full time

    If you are an extraordinary developer who loves to push the boundaries to solve complex business problems using creative solutions, then we wish to talk with you. As an Analytics Technology Engineer, you will work with the Technology team that helps deliver our Data Engineering offerings at large scale to our Fortune clients worldwide. The role is...


  • Delhi, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • QA Engineer

    32 minutes ago


    delhi, India Data Unveil Full time

    Position Title: QA EngineerLevel: Mid-LevelLocation: Hyderabad, Telangana.Hire Type: Full TimeStart Date: ImmediateMinimum 3+ years of QA experience in data projects.Collaborate with the Development/Business teams to understand the requirements.Analyzing Business Requirements/cases and developing/managing the positive/negative test scenarios cases.Ability to...


  • new delhi, India TekWissen India Full time

    Minimum Requirement:8+ Years of experience in Data Engineering/ETL/Dashboarding/Data warehousing Hands on experience on both structured and unstructured data 5+ years hands on experience in the below tools: Spark, Java, Iceberg, Kafka, ECS, Python StreamSets, Informatica, GPSS, TDAM, ANSI SQL, UNIX Teradata, Greenplum, OracleResponsibilities:Experience in...

  • Data Engineer

    4 weeks ago


    New Delhi, India RTI International Full time

    OverviewThis position will be to support a wide range of environmental and natural resources research for clients such as the U.S. Environmental Protection Agency (EPA) and other clients. Research topics include climate change impacts, and adaptation and vulnerability/resilience. Research may also involve topics such as health and economic impacts of air...

  • Azure Data Engineer

    4 days ago


    new delhi, India Quantzig Full time

    About Quantzig:Quantzig is a global analytics & advisory firm with offices in the US, UK, Canada, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is built and...


  • New Delhi, India MASAN Group Full time

    Responsibilities:1. Data Strategy and Governance- Develop and implement the data strategy and roadmap aligned with the organisation's overall business goals and objectives- Define data governance policies and procedures to ensure data quality, security, and regulatory compliance- Establish data standards, best practices, and guidelines to promote consistent...