Data Engineer

3 weeks ago


New Delhi, India Blackstraw.ai Full time

Data Engineer

Company Name: Blackstraw.ai

Office Location: Delhi (Work from Office)

Job Type: Full-time

Experience: 4+ Years



Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods.


Job Requirements:

● Participate in the customer’s system design meetings and collect the functional/technical requirements.

● Build up data pipelines for consumption by the data science team.

● Skillful in ETL process and tools.

● Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.

● Experience in writing Python programs and SQL queries.

● Experience in SQL Query tuning.

● Experienced in Shell Scripting(Unix/Linux).

● Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.

● Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional.

● Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka

● Suggest and implement best practices in data integration.

● Guide the QA team in defining system integration tests as needed.

● Split the planned deliverables into tasks and assign them to the team.

● Needs to Maintain/Deploy the ETL code and follow the Agile methodology

● Needs to work on optimization wherever applicable.

● Good oral, written and presentation skills.


Preferred Qualifications:

● Degree in Computer Science, IT, or similar field; a Master’s is a plus.

● Hands-on experience with Python and Pyspark Or

● Hands-on experience with Spark and SCALA.

● Great numerical and analytical skills.

● Working knowledge of cloud platforms such as MS Azure, AWS, etc...

● Technical expertise with data models, data mining, and segmentation techniques


Key traits:

● Should have excellent communication skills.

● Should be self motivated and willing to work as part of a team.

● Should be able to collaborate and coordinate in a remote environment.

● Be a problem solver and be proactive to solve the challenges that come his way.


Company Profile:

Conceptualized as far back as 2015, and commencing full-time operations in 2018, Blackstraw technologies Pvt Ltd. is a software products and services company specializing in Artificial Intelligence (AI) and Machine Learning solutions for various industries. We support businesses around the world, including North America, Europe and Asia, working to simplify AI implementation through our platform that expedites data labeling, AI model-training, and cloud or on-premise deployments. With more than 1000 years of combined work-experience, the 250+-strong Blackstraw Team comprises various experts in the AI value chain. We are a fast-moving team that prides ourselves in rapidly identifying different use-cases and fine-tuning our products to suit specific business needs. We are focused on providing solutions related to computer vision, natural language processing, Data annotation tools for deep learning models, etc. To stay competitive in business, it is key for organizations to adopt and implement smart AI solutions and service offerings. However, most companies are unable to implement AI rapidly due to the complexity of existing solutions, inadequate data and cost implications. Our mission is to enable enterprises to adopt AI in an easier, cost-effective and time-efficient manner with a plug-and-play approach to their data. Blackstraw operations are based out of Canada, USA & India. Our head office is based in Florida, USA



  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Data Engineer

    4 weeks ago


    New Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position, you should...

  • Data Engineer

    4 weeks ago


    new delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should...

  • Data Engineer

    4 weeks ago


    New Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should...

  • Data Engineer

    1 week ago


    new delhi, India System Soft Technologies Full time

    Job Summary Overall, as a data engineer working within the Microsoft ecosystem, your role will be crucial in ensuring that the organization's data is accurate, reliable, and readily available for decision-making purposesQualificationAs a data engineer, your main responsibilities will involve designing, implementing, and maintaining data pipelines to...

  • Data Engineer

    1 week ago


    new delhi, India System Soft Technologies Full time

    Job SummaryOverall, as a data engineer working within the Microsoft ecosystem, your role will be crucial in ensuring that the organization's data is accurate, reliable, and readily available for decision-making purposesQualificationAs a data engineer, your main responsibilities will involve designing, implementing, and maintaining data pipelines to extract,...

  • Data Engineer

    1 week ago


    new delhi, India comfidentil Full time

    Data EngineerLocation: RemoteJob Type: Full-TimeWe are currently seeking a highly skilled and motivated Data Engineer with expertise in managingGreenplum PostgreSQLdatabases to join our team. With a minimum of6+ years of experience , the ideal candidate will play a crucial role in ensuring the reliability, performance, and scalability of our data...

  • Data Engineer

    5 days ago


    new delhi, India Expedify Full time

    Overview Expedify.iois looking for an intelligent and detailoriented Data Engineer tojoin our ever expanding team of data engineering and analytics. Thehire will be responsible for building and optimizing our datapipeline architecture optimizing data flow and suggesting the rightset of tooling for thesame.Ourcandidate will be working directly with the senior...

  • Data Engineer

    2 days ago


    New Delhi, India Cynosure Corporate Solutions Full time

    Data Engineer Office Location: Delhi (Work from Office)Job Type: Full-timeExperience: 3+ YearsJob Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by...

  • Data Engineer

    1 week ago


    new delhi, India Vaisesika Full time

    Vaisesikais urgently looking for Data Engineers with experience in Python, Pandas and Data Analytics.Location: RemoteExperience: 5+ yearsInterested candidates share their updated resume to

  • Data Engineer

    2 days ago


    New Delhi, India Cynosure Corporate Solutions Full time

    Data EngineerOffice Location: Delhi (Work from Office)  Job Type: Full-time  Experience: 3+ Years  Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for...

  • Data Engineer

    2 weeks ago


    New Delhi, India Uplers Full time

    Uplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through robust technical skill assessments tailored to specific roles. Uplers seamlessly...

  • Data Engineer

    2 weeks ago


    New Delhi, India Uplers Full time

    Uplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through robust technical skill assessments tailored to specific roles. Uplers seamlessly...

  • Data Engineer

    4 days ago


    New Delhi, India Cynosure Corporate Solutions Full time

    Job Description:We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. Tosucceed in this position, you should have strong...


  • new delhi, India MASAN Group Full time

    Responsibilities:1. Data Strategy and GovernanceDevelop and implement the data strategy and roadmap aligned with the organisation's overall business goals and objectivesDefine data governance policies and procedures to ensure data quality, security, and regulatory complianceEstablish data standards, best practices, and guidelines to promote consistent and...

  • Data Engineer

    3 days ago


    new delhi, India Cynosure Corporate Solutions Full time

    Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. Tosucceed in this position, you should have strong...

  • Data Engineer

    3 days ago


    New Delhi, India Cynosure Corporate Solutions Full time

    Job Description:We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. Tosucceed in this position, you should have strong...