Senior Data Engineer

3 days ago

india Shodh AI Full time

Company Description


Shodh AI is an AI technology company that enables businesses to build custom AI models tailored to their unique needs. Our platform simplifies the process of creating Enterprise Language Models (ELMs) that comprehend and utilize your company's language. Our models are versatile, deployable on any cloud service or directly on your servers, and accessible via an API. We have our own H100 clusters and are currently building tools for various unicorns, companies as well as DRDO. We were co-founded by a former Microsoft Cambridge engineer and a leading AI scientist from India, and our mission is to revolutionize businesses with AI that truly understands their operations.



Role Description


We are seeking a highly skilled and motivated Data Engineer proficient in data optimization, preprocessing, chunking large datasets, prompt engineering, synthetic data generation, modeling, ETL (Extract Transform Load), data visualization and DL frameworks. The ideal candidate will have a strong foundation in data science methodologies, be proficient in programming languages, and possess the ability to design and optimize prompts for large language models. This role involves working with cutting-edge technologies to deliver high-quality, innovative solutions that meet the evolving needs of our clientele. You will work closely with our AI team to ensure data quality, data availability, and data integrity to support the development of our AI models.



Expected


  • Experience in designing and implementing data pipelines and workflows.
  • Strong proficiency in data optimization, preprocessing, and chunking.
  • Data Engineering, Warehousing, Modeling, and ETL (Extract Transform Load) skills.
  • Proficiency in Python, deep learning frameworks, and distributed architectures such as Hadoop, FSDP, DDP, CUDA, and multiprocessing is essential.
  • Experience with prompt engineering and synthetic data generation.
  • Solid understanding of data visualization techniques and tools.
  • Proficiency in Python programming and familiarity with relevant libraries (e.g., Pandas, NumPy, Scikit-learn).
  • Proficiency in SQL and database management systems.



Qualifications


  • Been in an leadership role of a product/tech team before.
  • Project management skills.
  • Knowledge of machine learning and statistical analysis.
  • Experience with cloud platforms and distributed computing.
  • Excellent communication and leadership skills.
  • Experience in the AI or technology industry is a plus.
  • Research experience is also a big plus.


Place:  Hybrid and Remote options (Company locations New York/Jaipur/Bangalore) 

DOJ:  At first availability 

Salary:  Competitive Salary (~ 15-25 LPA (Based in India)) and long term ESOP option. 

Term of employment:  If it fits, we are expecting you to be a long term member of the growth.

  • Operations Specialist

    1 week ago

    India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Senior Data Engineer

    3 weeks ago

    india RoundCircle Full time

    Round Circle is a leading technology company dedicated to leveraging data-driven insights to fuel innovation and drive business growth. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure,...

  • Senior Machine Learning Engineer

    1 week ago

    India K2 Data & Analytics Full time

    Job Title: Senior Machine Learning EngineerWe are currently seeking a highly motivated Senior Machine Learning Engineer with extensive experience exceeding five years to join our dynamic team dedicated to leading the way in innovative Video Ad Data solutions.The ideal candidate for this position should possess a strong knowledge of machine learning...

  • Senior Data Engineer

    1 week ago

    India Next-Link Full time

    Job Description Senior Data Engineer - Brussels - 12 moisOne of our important clients is currently looking for a Senior Data Engineer for a 12-month contract in Brussels.We are looking for a Senior Data Engineer who has extensive experience in developing and deploying data pipelines, infrastructure, and models for our data science projects. You will work...

  • Senior Data Engineer

    1 week ago

    India Mopid Full time

    Senior Data Engineer Position Experience Range: 4-8 years Job Timing: This position is full-time Job Type: The role requires working in-office from our Hyderabad location. If you are passionate about leveraging data to drive business success, have a keen eye for detail, and are looking for an opportunity to bring your expertise to a vibrant team, we would...

  • Senior Data Engineer

    1 week ago

    India hunterAI Full time

    Company Description Join hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    1 week ago

    India Rigel Networks Pvt. Ltd. Full time

    Role Description:This is role for a Senior Data Engineer specializing in PySpark, Python, and SQL.As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines.You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement data...

  • Senior Data Engineer

    4 weeks ago

    india OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION:• Analyze and understand  data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data•...

  • Senior Data Engineer

    3 weeks ago

    india OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION:• Analyze and understand  data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data•...

  • Senior Data Engineer

    1 week ago

    India Accelerant Full time

    Job Type: ContractLocation: IndiaExperience: 8+ yearsRequired Experience:Hands-on experience with Fivetran, AWS S3, DBT, Redshift, and TableauRole Description:We are looking for a Senior Data Engineer to join our team at Accelerant. As a Senior Data Engineer, you will play a crucial role in data modeling, ETL processes, data warehousing, and data analytics....

  • Senior Data Engineer

    1 month ago

    india Accelerant Full time

    Job Type - Contract Location- India Experience - 8+ years NOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau. Role Description This is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering,...

  • Senior Data Engineer

    1 week ago

    India Accelerant Full time

    Job Type - Contract Location- India Experience - 8+ years NOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau. Role Description This is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering,...

  • Senior Data Engineer

    1 month ago

    india PrimEra Medical Technologies Full time

    Job Description: Senior Data Engineer About PrimEra: PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact. Position Overview: We are seeking a highly skilled...

  • Senior Engineer

    2 days ago

    india NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Senior Data Engineer

    3 weeks ago

    india Next-Link Full time

    Job Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...

  • Senior Data Engineer

    1 week ago

    India Next-Link Full time

    Job Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...

  • Senior Data Engineer

    2 months ago

    india Next-Link Full time

    Job Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...

  • Senior Data Engineer

    1 week ago

    India OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer.Senior Data Engineer (Irving, Tx)JOB DESCRIPTION:• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and...

  • Senior Data Engineer

    2 weeks ago

    india MindBrain Full time

    Company Description. MindBrain seamlessly integrates innovation, education, and strategic workforce solutions. As a dynamic software company, we shape the future of technology. With a focus on comprehensive IT and non-IT training, we nurture talent, empowering individuals to lead in a rapidly evolving landscape. Through strategic resource augmentation, we...

  • Senior Machine Learning Engineer

    2 months ago

    india K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...