Data Engineer

1 week ago


Delhi, Delhi, India Wellborn Technologies Full time

Job Description:

We are seeking a talented and versatile Data Scraping and Natural LanguageProcessing (NLP) Engineer to join our dynamic team.

As a key member, you will be responsiblefor designing, developing, and maintaining web scrapers using Scrapy framework for dataextraction from various news websites, as well as implementing advanced NLP algorithms andmodels to extract valuable insights from unstructured text data.


You will be required to:

  • Design, develop, and maintain web scrapers using Scrapy framework for structured dataextraction.
  • Implement distributed crawling techniques to handle large-scale data extraction efficiently.
  • Utilize Docker for containerization and deployment of scraping applications.
  • Integrate SQL Alchemy for database management and storage of scraped data
  • Implement ML/NLP techniques for extracting entities like article headings, dates, authornames, and article content.
  • Develop and implement NLP algorithms and models to extract valuable information fromarticle data.
  • Deploy code on the server and integrate the extracted data into a MySQL database.
  • Utilize advanced NLP techniques and machine learning algorithms for tasks such as namedentity recognition (NER), sentiment analysis, topic modelling, etc.
  • Collaborate with cross-functional teams to understand requirements and refine algorithms.
  • Evaluate and improve the performance of NLP models through experimentation anditeration.
  • Monitor and optimize scraping and NLP processes for performance and reliability.
  • Stay up-to-date with the latest advancements in web scraping, NLP, and machine learningresearch.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or related field; Master's degreepreferred.
  • Relevant work experience of minimum 2-3 years
  • Proven experience with web scraping using Scrapy framework and natural languageprocessing (NLP) techniques.
  • Strong proficiency in Object-Oriented Programming (OOP) principles and Pythonprogramming language.
  • Experience with distributed crawling techniques and Docker for containerization anddeployment.
  • Familiarity with SQL Alchemy for database management and MySQL for databaseintegration.
  • Experience in implementing ML/NLP techniques for data extraction, sentiment analysis,named entity recognition (NER), topic modelling, etc.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills with the ability to explain complex technicalconcepts.
Ability to work independently and collaboratively in a fast-paced environment.

  • Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...


  • Delhi, Delhi, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • Delhi, Delhi, India NTT DATA Services Full time

    Req ID:273690NTT DATA Services is looking for a Digital Engineering Sr. Engineer to join their team in Delhi, India.Responsibilities: Manage and maintain the Appworx/UC4 batch scheduling system Create and modify job schedules as required Monitor job execution and ensure accuracy and timeliness Troubleshoot any issues during job execution Collaborate with...

  • Software Engineer

    1 week ago


    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:283993NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with the...

  • Software Engineer

    1 week ago


    Delhi, Delhi, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with the Senior...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position, you should have...


  • Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Responsibilities:- Manage and...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Edstem Technologies Full time

    Data Engineer (AI – Based Product Development)Roles: We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Evive | goevive Full time

    We're looking for a thorough Data Engineer. Is it you?The Data Engineer designs and builds the data pipelines that will enable faster and more accurate data-informed recommendations and decisions both inside and outside of the Evive platform. On a daily basis they design and build services to collect, compile, normalize, and analyze data assets coming from...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Birlasoft Full time

    About the Job - Data Engineer with 8 + years of experienceJob Title – Data EngineerLocation - Pune, Bangalore, Mumbai, Chennai, Hyderabad, NoidaEducational Background - UG -B.Tech /B.E in any specialization & PG.MCA/MSC in Computers.Key Responsibilities -Experience in implementing and managing data pipelines using modern orchestration tools like Azure Data...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Blitz Full time

    About us:Blitz is a company focused on Instant Logistics in Southeast Asia with a speciality in delivering orders using EV bikes. The company was established in 2021 and plays a big role in the EV bike sector by not only providing quick deliveries but also offering financing options for the bikes to drivers on lease. This additional revenue stream adds to...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Edstem Technologies Full time

    Data Engineer (AI – Based Product Development)Roles:We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Origins AI: Helping you learn and build Full time

    Company DescriptionAt Origins AI: Helping you learn and build, we are dedicated to unlocking the potential of artificial intelligence. As a gateway to expert consultancy services, we empower individuals and organizations to thrive in the ever-evolving world of AI.Role DescriptionThis is a remote contract role for a Data Engineer. The Data Engineer will be...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Birlasoft Full time

    About the Job Data Engineer with Azure, Hive and HadoopJob Title– Data EngineerLocation Pune, Bangalore, Mumbai, Chennai, Hyderabad, NoidaEducational Background UG B.Tech /B.E in any specialization & PG. MCA/MSC in Computers.Key Responsibilities -Experience in implementing and managing data pipelines using modern orchestration tools like Azure Data...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Birlasoft Full time

    About the Job Data Engineer with 8 + years of experienceJob Title– Data EngineerLocation Pune, Bangalore, Mumbai, Chennai, Hyderabad, NoidaEducational Background UG B.Tech /B.E in any specialization & PG. MCA/MSC in Computers.Key Responsibilities -Experience in implementing and managing data pipelines using modern orchestration tools like Azure Data...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Akkodis Full time

    Position: Data EngineerWe are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in our data infrastructure, leveraging your expertise in SQL, Teradata, GitLab, ETL processes, SSIS integration, data transformation, and data structures.Responsibilities: Design, develop, and maintain efficient data...