Data Engineer

7 months ago


tamil nadu, India Blackstraw.ai Full time
Data Engineer
Company Name: Blackstraw.ai
Office Location: Chennai (Work from Office)
Job Type: Full-time
Experience: 4+ Years
Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods.
Job Requirements :
● Participate in the customer’s system design meetings and collect the functional/technical requirements.
● Build up data pipelines for consumption by the data science team.
● Skillful in ETL process and tools.
● Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.
● Experience in writing Python programs and SQL queries.
● Experience in SQL Query tuning.
● Experienced in Shell Scripting(Unix/Linux).
● Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.
● Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional.
● Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka
● Suggest and implement best practices in data integration.
● Guide the QA team in defining system integration tests as needed.
● Split the planned deliverables into tasks and assign them to the team.
● Needs to Maintain/Deploy the ETL code and follow the Agile methodology
● Needs to work on optimization wherever applicable.
● Good oral, written and presentation skills.
Preferred Qualifications :
● Degree in Computer Science, IT, or similar field; a Master’s is a plus.
● Hands-on experience with Python and Pyspark Or
● Hands-on experience with Spark and SCALA.
● Great numerical and analytical skills.
● Working knowledge of cloud platforms such as MS Azure, AWS, etc...
● Technical expertise with data models, data mining, and segmentation techniques
Key traits :
● Should have excellent communication skills.
● Should be self motivated and willing to work as part of a team.
● Should be able to collaborate and coordinate in a remote environment.
● Be a problem solver and be proactive to solve the challenges that come his way.
Company Profile:
Conceptualized as far back as 2015, and commencing full-time operations in 2018, Blackstraw technologies Pvt Ltd. is a software products and services company specializing in Artificial Intelligence (AI) and Machine Learning solutions for various industries. We support businesses around the world, including North America, Europe and Asia, working to simplify AI implementation through our platform that expedites data labeling, AI model-training, and cloud or on-premise deployments. With more than 1000 years of combined work-experience, the 250+-strong Blackstraw Team comprises various experts in the AI value chain. We are a fast-moving team that prides ourselves in rapidly identifying different use-cases and fine-tuning our products to suit specific business needs. We are focused on providing solutions related to computer vision, natural language processing, Data annotation tools for deep learning models, etc. To stay competitive in business, it is key for organizations to adopt and implement smart AI solutions and service offerings. However, most companies are unable to implement AI rapidly due to the complexity of existing solutions, inadequate data and cost implications. Our mission is to enable enterprises to adopt AI in an easier, cost-effective and time-efficient manner with a plug-and-play approach to their data. Blackstraw operations are based out of Canada, USA & India. Our head office is based in Florida, USA

  • tamil nadu, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly skilled and dynamic Senior Engineer in Business Intelligence (BI) to spearhead our BI initiatives. The ideal candidate will have expertise in AWS QuickSight, Tableau and Power BI, along with strong cloud knowledge, communication skills, and a background in ETL/Data Warehousing.Key Responsibilities:Develop and lead the...

  • Senior bi engineer

    19 hours ago


    Tamil Nadu, India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly skilled and dynamic Senior Engineer in Business Intelligence (BI) to spearhead our BI initiatives. The ideal candidate will have expertise in AWS Quick Sight, Tableau and Power BI, along with strong cloud knowledge, communication skills, and a background in ETL/Data Warehousing. Key Responsibilities: Develop...

  • Senior BI Engineer

    2 days ago


    Tamil Nadu, India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly skilled and dynamic Senior Engineer in Business Intelligence (BI) to spearhead our BI initiatives. The ideal candidate will have expertise in AWS QuickSight, Tableau and Power BI, along with strong cloud knowledge, communication skills, and a background in ETL/Data Warehousing. Key Responsibilities: Develop...

  • Senior BI Engineer

    3 days ago


    Tamil Nadu, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly skilled and dynamic Senior Engineer in Business Intelligence (BI) to spearhead our BI initiatives. The ideal candidate will have expertise in AWS QuickSight, Tableau and Power BI, along with strong cloud knowledge, communication skills, and a background in ETL/Data Warehousing.Key Responsibilities:Develop and lead the...

  • Senior BI Engineer

    2 days ago


    Tamil Nadu, India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly skilled and dynamic Senior Engineer in Business Intelligence (BI) to spearhead our BI initiatives. The ideal candidate will have expertise in AWS QuickSight, Tableau and Power BI, along with strong cloud knowledge, communication skills, and a background in ETL/Data Warehousing. Key Responsibilities: Develop and lead...


  • tamil nadu, India Crayon Data Full time

    Role:AI Architect Exp: 10 to 15 yrsLocation: Chennai(Hybrid)In non-cloud Large Language Model (LLM) deployments, the AI Architect serves as a strategic leader, driving the alignment of AI solutions with business objectives while addressing critical challenges like scalability, governance, and security. Their role ensures sustainable and impactful AI...


  • tamil nadu, India NTT DATA Business Solutions Full time

    NTT DATA Business Solutions We want to shape the future with vision and innovation.Be part of it and develop your full potential!As part of the global NTT DATA Group, one of the most successful IT service providers in the world, we specialize in value-added SAP solutions as NTT DATA Business Solutions. With over 10,000 employees in more than 30 countries,...

  • Data Engineer

    4 months ago


    tamil nadu, India CYGNVS Full time

    Data EngineerLocation: Chennai (Hybrid)We’re looking for Data Engineers on our Analytics Engineering team - you’ll collaborate with teams across the globe to build pipelines and systems to deliver data insights critical to our customers and internal teams. You’ll be part of a cross functional team that’s responsible for the full product development...


  • tamil nadu, India Sensiple Full time

    Job Summary We are seeking a highly skilled and experienced Azure Data Engineering Tech Lead to design, develop, and implement end-to-end data solutions on the Azure platform. The ideal candidate will lead a team of data engineers, ensuring the delivery of high-quality, scalable, and secure data pipelines and architectures to support business intelligence...


  • tamil nadu, India Sensiple Full time

    Job SummaryWe are seeking a highly skilled and experienced Azure Data Engineering Tech Lead to design, develop, and implement end-to-end data solutions on the Azure platform. The ideal candidate will lead a team of data engineers, ensuring the delivery of high-quality, scalable, and secure data pipelines and architectures to support business intelligence and...


  • tamil nadu, India Sensiple Full time

    Job SummaryWe are seeking a highly skilled and experienced Azure Data Engineering Tech Lead to design, develop, and implement end-to-end data solutions on the Azure platform. The ideal candidate will lead a team of data engineers, ensuring the delivery of high-quality, scalable, and secure data pipelines and architectures to support business intelligence and...


  • tamil nadu, India Clustrex Data Private Limited Full time

    Title : Python DeveloperExperience : 6 + yearsLocation : On-site Madipakkam, ChennaiRole DescriptionThis is a full-time, on-site role for a Python Developer at Clustrex Data Private Limited in Chennai. As a Python Developer, you will be responsible for developing and maintaining the back-end of web and mobile applications, writing clean and efficient code,...


  • tamil nadu, India LTIMindtree Full time

    Skill: ADB+ADF+ Snowflakes +SQL+PYSPARK Experience: 5-10YrsLocation: All LTIM locations:(Pune, Mumbai, Noida, Chennai ,Bangalore ,Hyderabad, Kolkata)JD: (8-12 yrs)Must have skillsMinimum 8 years experience of Data EngineeringExperience in ETLPipeline Development using tools such as Azure DatabricksApache Spark and Azure DataFactory with development...


  • tamil nadu, India LTIMindtree Full time

    Skill: ADB+ADF+ Snowflakes +SQL+PYSPARKExperience: 5-10YrsLocation: All LTIM locations:(Pune, Mumbai, Noida, Chennai ,Bangalore ,Hyderabad, Kolkata)JD: (8-12 yrs)Must have skillsMinimum 8 years experience of Data EngineeringExperience in ETLPipeline Development using tools such as Azure DatabricksApache Spark and Azure DataFactory with development expertise...

  • Senior Data Engineer

    2 months ago


    tamil nadu, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience in Data Bricks Engineer Along with any cloud experience.Experience Required: 7- 14 YearsLocation: Coimbatore, Tamil Nadu, IndiaResponsibilitiesDesign, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake.Build...


  • tamil nadu, India Recro Full time

    The tech stack in brief:● Strong experience in Python, Pyspark with SQL● Augmentation of existing ELT pipelines or building new pipelines fromscratch.● Preferred DE cloud exp with Azure synapse, ADLS, ADF and Data bricks.● If not worked with Azure then secondary cloud exp in AWS and Snowflakewill work.● Big Data experience with the Hadoop...

  • Senior Data Engineer

    2 months ago


    tamil nadu, India Blackstraw Full time

    Data EngineerCompany Name: Blackstraw.aiOffice Location: Chennai (Work from Office)Job Type: Full-timeExperience: 6+ YearsJob Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll...

  • Senior Engineer

    7 months ago


    tamil nadu, India Tiger Analytics Full time

    Role: Senior Engineer – Quality EngineeringWork Location – Chennai, Bangalore or HyderabadTiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our 4000+ tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a...


  • tamil nadu, India Wavicle Data Solutions Full time

    Job Summary:The AWS DevOps Engineer is responsible for provisioning, operating, and managing AWS cloud environments. They work with development, operations, and security teams to deploy, operate, and scale AWS environments. They are also responsible for automating and improving the AWS environment.Responsibilities ‍Assists in defining automated monitoring,...


  • tamil nadu, India System Soft Technologies Full time

    Job Description – Snowflake Data EngineerSystem Soft Technologies is a premier technology company providing exceptional consulting services and solutions that drive innovation, enhance business value, and boost competitiveness. For over 25 years, we have built trusted partnerships with our clients, helping us grow into a $200MM+ enterprise. With the...