Data Engineer

4 weeks ago


new delhi, India Wellborn Technologies Full time

Job Description: We are seeking a talented and versatile Data Scraping and Natural Language

Processing (NLP) Engineer to join our dynamic team. As a key member, you will be responsible

for designing, developing, and maintaining web scrapers using Scrapy framework for data

extraction from various news websites, as well as implementing advanced NLP algorithms and

models to extract valuable insights from unstructured text data.


You will be required to:

 Design, develop, and maintain web scrapers using Scrapy framework for structured data

extraction.

 Implement distributed crawling techniques to handle large-scale data extraction efficiently.

 Utilize Docker for containerization and deployment of scraping applications.

 Integrate SQL Alchemy for database management and storage of scraped data

 Implement ML/NLP techniques for extracting entities like article headings, dates, author

names, and article content.

 Develop and implement NLP algorithms and models to extract valuable information from

article data.

 Deploy code on the server and integrate the extracted data into a MySQL database.

 Utilize advanced NLP techniques and machine learning algorithms for tasks such as named

entity recognition (NER), sentiment analysis, topic modelling, etc.

 Collaborate with cross-functional teams to understand requirements and refine algorithms.

 Evaluate and improve the performance of NLP models through experimentation and

iteration.

 Monitor and optimize scraping and NLP processes for performance and reliability.

 Stay up-to-date with the latest advancements in web scraping, NLP, and machine learning

research.


Requirements:

 Bachelor's degree in Computer Science, Engineering, or related field; Master's degree

preferred.

 Relevant work experience of minimum 2-3 years

 Proven experience with web scraping using Scrapy framework and natural language

processing (NLP) techniques.

 Strong proficiency in Object-Oriented Programming (OOP) principles and Python

programming language.

 Experience with distributed crawling techniques and Docker for containerization and

deployment.

 Familiarity with SQL Alchemy for database management and MySQL for database

integration.


 Experience in implementing ML/NLP techniques for data extraction, sentiment analysis,

named entity recognition (NER), topic modelling, etc.

 Excellent problem-solving skills and attention to detail.

 Strong communication and collaboration skills with the ability to explain complex technical

concepts.

 Ability to work independently and collaboratively in a fast-paced environment.


  • Operations Specialist

    1 month ago


    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...


  • delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...


  • New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • New Delhi, India NTT DATA Full time

    Job Description Req ID: 273690 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • New Delhi, India NTT DATA Full time

    Job Description Req ID: 273690 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • new delhi, India NTT DATA Full time

    Job Description Req ID:  273690  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)....


  • new delhi, India NTT DATA Full time

    Job Description Req ID:  273690  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)....

  • Software Engineer

    3 weeks ago


    New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:283993NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with the...

  • Software Engineer

    3 weeks ago


    New Delhi, India NTT DATA Full time

    Job Description Req ID: 283993 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with the...


  • New Delhi, India NTT DATA Services Full time

    Req ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Responsibilities:- Manage...


  • New Delhi, India NTT DATA Services Full time

    Req ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Responsibilities:- Manage...

  • Lead Engineer

    3 weeks ago


    New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:282070NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."RPA Consultant (C)Once You Are...


  • new delhi, India NTT DATA Services Full time

    Req ID:  273690  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN). Responsibilities:-...


  • new delhi, India NTT DATA Services Full time

    Req ID:  273690  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN). Responsibilities:-...

  • Data Engineer

    2 months ago


    New Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should...

  • Data Engineer

    2 months ago


    new delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should...