Data Engineer

3 weeks ago

tamil nadu, India Blackstraw.ai Full time
Data Engineer
Company Name: Blackstraw.ai
Office Location: Chennai (Work from Office)
Job Type: Full-time
Experience: 4+ Years
Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods.
Job Requirements :
● Participate in the customer’s system design meetings and collect the functional/technical requirements.
● Build up data pipelines for consumption by the data science team.
● Skillful in ETL process and tools.
● Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.
● Experience in writing Python programs and SQL queries.
● Experience in SQL Query tuning.
● Experienced in Shell Scripting(Unix/Linux).
● Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.
● Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional.
● Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka
● Suggest and implement best practices in data integration.
● Guide the QA team in defining system integration tests as needed.
● Split the planned deliverables into tasks and assign them to the team.
● Needs to Maintain/Deploy the ETL code and follow the Agile methodology
● Needs to work on optimization wherever applicable.
● Good oral, written and presentation skills.
Preferred Qualifications :
● Degree in Computer Science, IT, or similar field; a Master’s is a plus.
● Hands-on experience with Python and Pyspark Or
● Hands-on experience with Spark and SCALA.
● Great numerical and analytical skills.
● Working knowledge of cloud platforms such as MS Azure, AWS, etc...
● Technical expertise with data models, data mining, and segmentation techniques
Key traits :
● Should have excellent communication skills.
● Should be self motivated and willing to work as part of a team.
● Should be able to collaborate and coordinate in a remote environment.
● Be a problem solver and be proactive to solve the challenges that come his way.
Company Profile:
Conceptualized as far back as 2015, and commencing full-time operations in 2018, Blackstraw technologies Pvt Ltd. is a software products and services company specializing in Artificial Intelligence (AI) and Machine Learning solutions for various industries. We support businesses around the world, including North America, Europe and Asia, working to simplify AI implementation through our platform that expedites data labeling, AI model-training, and cloud or on-premise deployments. With more than 1000 years of combined work-experience, the 250+-strong Blackstraw Team comprises various experts in the AI value chain. We are a fast-moving team that prides ourselves in rapidly identifying different use-cases and fine-tuning our products to suit specific business needs. We are focused on providing solutions related to computer vision, natural language processing, Data annotation tools for deep learning models, etc. To stay competitive in business, it is key for organizations to adopt and implement smart AI solutions and service offerings. However, most companies are unable to implement AI rapidly due to the complexity of existing solutions, inadequate data and cost implications. Our mission is to enable enterprises to adopt AI in an easier, cost-effective and time-efficient manner with a plug-and-play approach to their data. Blackstraw operations are based out of Canada, USA & India. Our head office is based in Florida, USA

  • Data Engineer

    2 weeks ago

    tamil nadu, India BU Soft Tech Full time

    Experience - 3 to 4 yrs as Data EngineerTech Stack - Python, Pyspark, SQL, AWS &Bachelor's degree in Computer Science, Engineering, or related field.Excellent written and verbal communication skills.Location - ChennaiRole DescriptionThis is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be responsible...

  • Data Engineer

    7 days ago

    tamil nadu, India Live Connections Full time

    Immediate Opening For Data Engineer with ODI, Big Data, Power BI and Spark.Please connect on LinkedIn for a swift profile process.Role: Data Engineer.Mandate Skill: Data Engineer with ODI, Big Data, Power BI and Spark,Experience: 7+ Yrs OnlyNotice Period: Immediate to 20 Days OnlySalary Range: 14 to 16 LPALocation: Chennai (Tamil Nadu Only)Working...

  • Data Engineer

    6 days ago

    Tamil Nadu, India SP Software Solutions Full time

    Tableau + SQL + SnowflakeNo. of Positions - 1Location – PAN IndiaCan work in anywhere at client location in India. Experience – 7+ YearsWe are seeking a skilled and experienced Data Engineer with 7+ years of expertise to join our data analytics team. The ideal candidate should have a strong background in Tableau, along with proficiency in Snowflake and...

  • Data Engineer

    5 days ago

    tamil nadu, India SP Software Solutions Full time

    Tableau + SQL + Snowflake No. of Positions - 1 Location – PAN India Can work in anywhere at client location in India. Experience – 7+ Years We are seeking a skilled and experienced Data Engineer with 7+ years of expertise to join our data analytics team. The ideal candidate should have a strong background in Tableau, along with proficiency in Snowflake...

  • Data Engineer

    7 days ago

    tamil nadu, India Altimetrik Full time

    Role : Data EngineerYears of experience : 4-10.Job Location: ChennaiJob Description :Position Overview: We are seeking a skilled Data Engineer with a solid understanding of Google Cloud Platform (GCP) technologies. The ideal candidate will have extensive experience with Big Query, Google Cloud Storage (GCS), Data Ingestion, Data Flow, and Pub/Sub....

  • Sr. Data Engineer

    5 days ago

    tamil nadu, India CoreStack Full time

    Job Title: Senior Data EngineerLocation: ChennaiAbout UsCoreStack provides a NextGen Cloud Governance platform that empowers enterprises to increase top-line revenues and gain a competitive edge through AI-powered real-time cloud governance on autopilot.CoreStack is successfully deployed with companies across multiple industries such as Healthcare,...

  • GCP Data Engineer

    13 hours ago

    tamil nadu, India TekWissen India Full time

    Role: GCP Data EngineerLocation: Chennai, IndiaExperience: 4+ yearsNotice Period: Immediate to 15 days joinersPosition Description:We are looking for an experienced data engineer to join our growing software engineering product team responsible for supporting finished vehicle logistics at Client Motor Company.As a team member of this product team at Client...

  • Data Migration Engineer

    5 days ago

    tamil nadu, India Unison Consulting Full time

    As a Data Migration Engineer,You will play a key role in the successful migration of data from SAS to PySpark.You will work closely with our cross-functional teams and be responsible for ensuring the seamless transition of our data processes.To excel in this role,you should possess extensive experience in SAS, Spark, and Python, with a strong background in...

  • Assistant Manager Data Engineer

    4 days ago

    tamil nadu, India LatentView Analytics Full time

    We are seeking a highly skilled and motivated Technical Manager with a good hands-on & expertise in Data Engineering, particularly in the Azure ecosystem. The ideal candidate will play a key role in leading a dynamic team, driving data engineering initiatives, and ensuring the successful delivery of projects. In addition to technical proficiency, this role...

  • Data Engineering

    5 days ago

    tamil nadu, India InfoCepts Full time

    Position: Data Engineering - Project ManagerLocation: ChennaiPurpose of the Position:As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, and management of data engineering solutions. As a member of the team, you will help our...

  • Senior Engineer

    3 weeks ago

    tamil nadu, India Tiger Analytics Full time

    Role: Senior Engineer – Quality EngineeringWork Location – Chennai, Bangalore or HyderabadTiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our 4000+ tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams. They...

  • Data Engineer II

    5 days ago

    tamil nadu, India NAF Technology India Full time

    About our companyNew American Funding (NAF) is a mortgage lender offering an array of loan options. Established in 2003 and headquartered in Tustin, CA, United States, NAF has 3,640 + strong workforce across 190 branches and a servicing portfolio of 247,470+ loans and $65.3 Billion.The data services technology team at New American Funding is planning...

  • Senior Data Engineer

    3 weeks ago

    tamil nadu, India TivonaGlobal Technologies Full time

    Tivona Global is looking for a Senior Data Engineer to work on Cloud Native Application development projects as a part of our development team based out of Chennai. The Senior Data Engineer will be responsible for developing APIs and cloud native applications including serverless applications using Python and various AWS cloud native/serverless services.Send...

  • Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams. They...

  • Data Lead

    4 weeks ago

    tamil nadu, India Hexaware Technologies Full time

    Job DescriptionCollibra Implementation Engineer (Data Governance & Data Quality)8+ years of experience in Data management, data quality and data governance and 2+ experience in implementation/Support of Collibra.Understand the implementation process flow of Collibra starting with Operating model to policies and rules.Working experience in Collibra’s...

  • Business Support Associate

    1 week ago

    Coimbatore, Tamil Nadu, India NTT DATA Full time

    Understand, Gather and Prepare the requirements for Business. - Works under supervision with internal and external teams to understand customer requirements - Ability to elaborate on the details of a project - Collaborate with Automation Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables. - Must possess technical writing,...

  • MS SQL Server Data Engineer

    4 weeks ago

    tamil nadu, India Hitachi Energy Full time

    Hitachi Energy, High Voltage Products is implementing Digital solutions to improve efficiency and quality. These are cloud-based solutions that will be used by all manufacturing units within the business unit.Roles and Responsibilities:Strong experience on Microsoft SQL Server and developing T-SQL (Transact SQL) Stored Procedures, Functions and Triggers,...

  • Data Scientist

    7 days ago

    tamil nadu, India Tiger Analytics Full time

    Job Title: Data ScientistIndia Locations: Chennai | Hyderabad | BangaloreTiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our 3900+ tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset....

  • Lead Data Scientist

    2 weeks ago

    tamil nadu, India Impetus Career Consultants Full time

    PhD with 6+ years of experience, Master's degree with 8+ years of experience, or Bachelor's degree with 15+ years of experience in Computer Science, Engineering, Applied mathematics or related field7+ years of hands-on ML modeling/development experienceExtensive experience in deep learning models including Large Language Models (LLM) and Natural Language...