Data Engineer
1 month ago
Codepan – founded in 2014 – is a Berlin-based AI Innovation Hub. Our team of passionate data scientists, engineers, and technologists applies machine learning to solve real-world problems for clients as well as to incubate and accelerate our own AI product ideas.
Codepan is currently developing an AI-based product using capabilities of state-of-the-art LLM technologies in the space of Intelligent Document processing.
TasksAs a Data Engineer in our team, you'll architect, build, and maintain advanced data pipelines and storage solutions. You'll play a pivotal role in enabling our analytics and AI teams to work efficiently with large datasets, including those used for training and deploying Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) models.
Key Responsibilities:
- Design and optimize scalable data pipelines to support advanced analytics, machine learning, and AI projects, with a particular focus on applications involving LLMs and RAGs.
- Develop robust data warehousing solutions that ensure fast, reliable access to large volumes of data, optimizing for query performance and system scalability.
- Collaborate with AI research and development teams to understand data requirements and ensure the seamless integration of AI models with our data ecosystem.
- Implement data governance and security measures, adhering to best practices and regulatory standards to safeguard sensitive information.
- Utilize and advocate for cloud-based technologies and services to enhance our data processing capabilities, ensuring our infrastructure is both flexible and cost-effective.
- Regularly evaluate and adopt new tools and technologies to keep our data infrastructure at the forefront of industry standards, particularly those enhancing LLM and RAG functionalities.
- Simplify complex data flows, making data easily accessible for non-technical stakeholders while maintaining the integrity and confidentiality of the data.
- Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.
- At least 5+ years of proven experience in data engineering, with a track record of developing scalable data solutions.
- Strong technical expertise in SQL/NoSQL databases, Python, Java, and ETL processes.
- Experience with cloud platforms (Azure/GCP) and familiarity with big data technologies.
- A keen interest in AI technologies, especially LLMs and RAG models, with a desire to stay updated on the latest trends and techniques.
- Solid foundation in data security principles and a commitment to implementing privacy-compliant data management practices.
- Excellent problem-solving skills, ability to work collaboratively in a team environment, and strong communication skills for explaining complex technical concepts.
Join us to contribute to cutting-edge projects in AI and analytics, leveraging your expertise to create impactful data solutions.
Salary: 30L - 35L, remote job in India
Codepan is a boutique agency focused on building innovative, AI-driven products & solutions for clients.
-
Data Engineer
3 weeks ago
New Delhi, India Aprisity Technologies Full timeWe are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position, you should...
-
Data Engineer
3 weeks ago
new delhi, India Aprisity Technologies Full timeWe are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should...
-
Data Engineer
3 weeks ago
New Delhi, India Aprisity Technologies Full timeWe are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should...
-
Data Engineer
6 hours ago
new delhi, India System Soft Technologies Full timeJob Summary Overall, as a data engineer working within the Microsoft ecosystem, your role will be crucial in ensuring that the organization's data is accurate, reliable, and readily available for decision-making purposesQualificationAs a data engineer, your main responsibilities will involve designing, implementing, and maintaining data pipelines to...
-
Data Engineer
4 hours ago
new delhi, India comfidentil Full timeData EngineerLocation: RemoteJob Type: Full-TimeWe are currently seeking a highly skilled and motivated Data Engineer with expertise in managingGreenplum PostgreSQLdatabases to join our team. With a minimum of6+ years of experience , the ideal candidate will play a crucial role in ensuring the reliability, performance, and scalability of our data...
-
Data Engineer
4 hours ago
new delhi, India Vaisesika Full timeVaisesikais urgently looking for Data Engineers with experience in Python, Pandas and Data Analytics.Location: RemoteExperience: 5+ yearsInterested candidates share their updated resume to
-
Data Engineer
2 weeks ago
New Delhi, India Terminus Full timeRole We are looking for a Data Engineer to join our team who will be involved data management and transformation at scale and optimize to prepare the data pipe for the AI /Analytical technology stack. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The...
-
Data Engineer
4 days ago
New Delhi, India Uplers Full timeUplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through robust technical skill assessments tailored to specific roles. Uplers seamlessly...
-
Data Engineer
2 days ago
New Delhi, India Uplers Full timeUplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through robust technical skill assessments tailored to specific roles. Uplers seamlessly...
-
Data Engineering Manager
4 weeks ago
New Delhi, India Woolworths Group International Full timeWhat we're likeAt BIG W every day's a big day. For you, this could be the start of something big.There are over 15,000 of us, in the biggest cities and the tiniest towns. And each of us has an important role to play to help make a real difference for families by providing real value, real solutions and real care.If you have a passion for designing and...
-
Head Of Data Engineer
2 days ago
new delhi, India MASAN Group Full timeResponsibilities:1. Data Strategy and GovernanceDevelop and implement the data strategy and roadmap aligned with the organisation's overall business goals and objectivesDefine data governance policies and procedures to ensure data quality, security, and regulatory complianceEstablish data standards, best practices, and guidelines to promote consistent and...
-
Data Engineer
1 week ago
new delhi, India Tata Technologies Full timePosition :- Data Engineer (Snowflake)Location :- PuneExp. Rane :- 4-6 yearsMust Have:4-6 Years Overall experience4+ years of experience with sound knowledge on database concepts like Entity-relationship, Data modeling, DDL and DML statements etc.3+ years of proven experience in Snowflake in data modelling, data pipelines, data governance and performance...
-
Head Of Data Engineer
2 days ago
New Delhi, India MASAN Group Full timeResponsibilities:1. Data Strategy and GovernanceDevelop and implement the data strategy and roadmap aligned with the organisation's overall business goals and objectivesDefine data governance policies and procedures to ensure data quality, security, and regulatory complianceEstablish data standards, best practices, and guidelines to promote consistent and...
-
Head Of Data Engineer
2 days ago
New Delhi, India MASAN Group Full timeResponsibilities:1. Data Strategy and GovernanceDevelop and implement the data strategy and roadmap aligned with the organisation's overall business goals and objectivesDefine data governance policies and procedures to ensure data quality, security, and regulatory complianceEstablish data standards, best practices, and guidelines to promote consistent and...
-
Head Of Data Engineer
3 days ago
new delhi, India MASAN Group Full timeResponsibilities: 1. Data Strategy and Governance Develop and implement the data strategy and roadmap aligned with the organisation's overall business goals and objectives Define data governance policies and procedures to ensure data quality, security, and regulatory compliance Establish data standards, best practices, and guidelines to promote consistent...
-
Senior Data Engineer
1 week ago
new delhi, India Narwal Full timeAbout Us:Narwal, with its Global Delivery Model, strategically expands its reach across North America, the United Kingdom, and an offshore development centre in India. Delivery cutting edge AI, Data, Cloud and Quality Engineering solutions and consistently surpassing expectations, Narwal has achieved remarkable triple-digit growth rates year after year,...
-
Data Engineer
2 weeks ago
New Delhi, India Blackstraw.ai Full timeData Engineer Company Name: Blackstraw.ai Office Location: Delhi (Work from Office) Job Type: Full-time Experience: 4+ Years Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall,...
-
Data Engineer- Tigergraph
1 month ago
new delhi, India Fractal Full timeIf you are an extraordinary developer who loves to push the boundaries to solve complex business problems using creative solutions, then we wish to talk with you. As an Analytics Technology Engineer, you will work with the Technology team that helps deliver our Data Engineering offerings at large scale to our Fortune clients worldwide. The role is...
-
Specialist Data center operations
1 month ago
Delhi, India NTT DATA Full timeThe role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...
-
QA Engineer
2 days ago
delhi, India Data Unveil Full timePosition Title: QA EngineerLevel: Mid-LevelLocation: Hyderabad, Telangana.Hire Type: Full TimeStart Date: ImmediateMinimum 3+ years of QA experience in data projects.Collaborate with the Development/Business teams to understand the requirements.Analyzing Business Requirements/cases and developing/managing the positive/negative test scenarios cases.Ability to...