Senior Data Engineer

2 months ago

Flower Bazaar, India Blackstraw Full time
Data Engineer Company Name: Blackstraw.AiOffice Location: Chennai (Work from Office)Job Type: Full-timeExperience: 6+ YearsJob Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods.Job Requirements:● Participate in the customer’s system design meetings and collect the functional/technical requirements.● Build up data pipelines for consumption by the data science team.● Skillful in ETL process and tools.● Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.● Experience in writing Python programs and SQL queries.● Experience in SQL Query tuning.● Experienced in Shell Scripting(Unix/Linux).● Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.● Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional.● Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka● Suggest and implement best practices in data integration.● Guide the QA team in defining system integration tests as needed.● Split the planned deliverables into tasks and assign them to the team.● Needs to Maintain/Deploy the ETL code and follow the Agile methodology● Needs to work on optimization wherever applicable.● Good oral, written and presentation skills.Preferred Qualifications:● Degree in Computer Science, IT, or similar field;

a Master’s is a plus.● Hands-on experience with Python and Pyspark Or● Hands-on experience with Spark and SCALA.● Great numerical and analytical skills.● Working knowledge of cloud platforms such as MS Azure, AWS, etc...● Technical expertise with data models, data mining, and segmentation techniquesKey traits:● Should have excellent communication skills.● Should be self motivated and willing to work as part of a team.● Should be able to collaborate and coordinate in a remote environment.● Be a problem solver and be proactive to solve the challenges that come his way.Company Profile: Conceptualized as far back as 2015, and commencing full-time operations in 2018, Blackstraw technologies Pvt Ltd. is a software products and services company specializing in Artificial Intelligence (AI) and Machine Learning solutions for various industries. We support businesses around the world, including North America, Europe and Asia, working to simplify AI implementation through our platform that expedites data labeling, AI model-training, and cloud or on-premise deployments. With more than 1000 years of combined work-experience, the 250+-strong Blackstraw Team comprises various experts in the AI value chain. We are a fast-moving team that prides ourselves in rapidly identifying different use-cases and fine-tuning our products to suit specific business needs. We are focused on providing solutions related to computer vision, natural language processing, Data annotation tools for deep learning models, etc. To stay competitive in business, it is key for organizations to adopt and implement smart AI solutions and service offerings. However, most companies are unable to implement AI rapidly due to the complexity of existing solutions, inadequate data and cost implications. Our mission is to enable enterprises to adopt AI in an easier, cost-effective and time-efficient manner with a plug-and-play approach to their data. Blackstraw operations are based out of Canada, USA & India. Our head office is based in Florida, USA

  • Senior Software Engineering Manager

    3 weeks ago

    Flower Bazaar, India Crayon Data Full time

    Job Title: Senior Software Engineering ManagerAbout Us:Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. Our flagship platform, maya.Ai, helps enterprises across the Banking, Fintech, and Travel industries create and capture sustainable revenue streams by...

  • Senior Data Engineer

    4 weeks ago

    Flower Bazaar, India Blackstraw Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Blackstraw. As a Senior Data Engineer, you will play a key role in designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data pipelines to collect, process, and...

  • Data Engineering Director

    4 weeks ago

    Flower Bazaar, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals.Key...

  • Senior Data Architect

    4 weeks ago

    Flower Bazaar, India E-Solutions Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our dynamic team at E-Solutions in Chennai. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining data pipelines and architectures that support our data-driven initiatives.Key Responsibilities:Develop and implement robust...

  • Senior Data Engineer

    3 weeks ago

    Flower Bazaar, India Tekion Corp Full time

    At Tekion, we are on a mission to build the world’s best applications. We aim to deliver solutions that are delightful to use, yet powerful enough to efficiently run global businesses. Starting with automotive retail, we are incorporating cutting-edge technologies to accelerate the transition of complex (and simple) businesses to the cloud and enable...

  • Senior Data Engineer

    3 weeks ago

    Flower Bazaar, India Agilisium Consulting Full time

    Key Qualifications:6+ Years of experience in Data Engineering · Proficient in AWS, SQL, Snowflake, Airflow, Databricks, Pyspark and Python· 6+ years of experience in data engineering and ETL pipeline development.· 6+ years of experience in Big Data Technologies and Interacting with external API to pull data .· Experience on Kubernetes, Docker...

  • Senior Data Manager

    4 weeks ago

    Flower Bazaar, India Matrimony Full time

    Job Title: Senior Data ManagerMatrimony is seeking a highly skilled Senior Data Manager to join our team in Chennai. As a key member of our Data Services team, you will be responsible for managing and mentoring a team of Data Engineering and BI professionals while driving the strategy behind our data warehouse.Key Responsibilities:Manage and mentor a team of...

  • Senior data engineer

    7 days ago

    Flower Bazaar, India Zocket Full time

    About Zocket Founded in 2021, Zocket leverages Gen AI to enable businesses to effortlessly create and launch ads in seconds. With Zocket, businesses can manage ads across channels like Facebook, Instagram, Google and Whats App in a single platform. Zocket's proprietary world-class tech stack is built with cutting edge Machine learning and Artificial...

  • Engineering Director

    4 weeks ago

    Flower Bazaar, India Crayon Data Full time

    Engineering ManagerCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We are seeking an experienced Engineering Manager to lead our technical teams and drive the development of our flagship platform, maya.Ai.Key ResponsibilitiesLead complex initiatives with...

  • Engineering Manager

    4 weeks ago

    Flower Bazaar, India Crayon Data Full time

    Job Title: Engineering ManagerCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We are seeking an experienced Engineering Manager to lead our technical teams and drive the development of our flagship platform, maya.Ai.Key Responsibilities:Lead complex initiatives...

  • Senior Cloud Engineer

    4 weeks ago

    Flower Bazaar, India Peninsular Research Operation Full time

    Senior Software EngineerWe are seeking an experienced Senior Software Engineer to join our team at Peninsular Research Operation. The ideal candidate will have a strong background in designing, developing, and managing highly scalable, microservices-driven cloud-based systems.Key ResponsibilitiesDesign, build, and maintain large-scale services, job...

  • Engineering Manager

    3 weeks ago

    Flower Bazaar, India Crayon Data Full time

    Role: Engineering Manager(UI)Experience level: 10+ yearsLocation: HybridWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.Ai, helps...

  • Data Engineer

    4 weeks ago

    Flower Bazaar, India IDP India Full time

    Job Title: Data EngineerAt IDP India, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and develop scalable data pipelines to process and analyze large...

  • Senior Data Analyst

    3 weeks ago

    Flower Bazaar, India The Happy Company Full time

    Company: The Happy Company®Vertical: ProductFunction(s): Data Analyst, MISLocation: Chennai, TNTitle: Senior Manager — ProductCTC: 15 LPAPosition Overview: The Senior Manager – Product Data Analyst will lead data-driven initiatives, focusing on customer insights, sales trends, and operational efficiency. The role requires managing the data, developing...

  • Machine Learning Engineer

    4 weeks ago

    Flower Bazaar, India Crayon Data Full time

    Job Title: Machine Learning EngineerCompany: Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We are seeking a highly skilled Machine Learning Engineer to join our team in Chennai.Job Summary:We are looking for a talented Machine Learning Engineer to...

  • Senior Data Scientist

    4 weeks ago

    Flower Bazaar, India Blackstraw Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist to lead our data science team and drive business growth through data-driven insights.Job SummaryAs a Senior Data Scientist, you will be responsible for managing the data science team, planning projects, and building analytics models to help us gain valuable insights from...

  • Data Engineer

    3 weeks ago

    Flower Bazaar, India Mastech InfoTrellis Full time

    Position: Azure Data Engineer(ADF Developer)Location: Chennai, Tamil Nadu(3 day/week) /non local- 1 week travel quarterlyDuration: Full TimeNotice Period: 15-30 days (Non negotiable) Required skill:ADF, ADLS, Pyspark, SynapseYears of experience: 5+ YearsJob Summary:We are seeking a talented and experienced Azure Data Engineer to join our team. As an Azure...

  • Data Engineer

    4 weeks ago

    Flower Bazaar, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Data Engineer Job DescriptionRiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) is seeking a highly skilled Data Engineer to join our team in Chennai. As a Data Engineer, you will be responsible for designing, developing, and maintaining the data platform and data-driven monitoring tools for risk and data science solutions in Big Data platform, using cutting-edge...

  • Senior Data Visualization Expert

    4 weeks ago

    Flower Bazaar, India Perficient India Full time

    Job Title: Senior Tableau DeveloperWe are seeking a highly skilled Senior Tableau Developer to join our team at Perficient India. As a Senior Tableau Developer, you will be responsible for designing and developing interactive data visualizations using Tableau.Key Responsibilities:Design and develop complex data visualizations using TableauDevelop and...

  • Data Engineer

    2 months ago

    Flower Bazaar, India IDP India Full time

    Responsibilities:In this role, you will be collaborating with IDP’s Data Engineering and Governance, an enterprise capability team, and be responsible for driving transformation efforts towards the right outcomes for students, clients, and the student placement network.Develops and maintains scalable data pipelines and builds out new API integrations to...