Hadoop Jobs

I’m looking for a seasoned developer (or small team) to turn the idea of a cloud-native AI platform into a working product that automates tender intelligence for the Dominican Republic’s DGCP portal, with an initial focus on Technology-sector bids. What I need the platform to do • Automatically ingest DGCP tender notices, specifications, addenda, and Q&A. • Use NLP to analyze each document, extract key dates, requirements, evaluation criteria, and risk flags, then present the insights in a clean web-based dashboard (our only required output format). • Generate pre-filled compliance documentation that aligns our internal policies with each tender’s mandatory clauses. • Run lightweight process audits—flagging missing approvals, outda...

I’m building a virtual DeepseekV3 environment that emulates Jet Nano hardware for research and development on machine-learning models. The goal is to give my team a sandbox where we can move seamlessly from data preprocessing and feature extraction through model training, evaluation, deployment, and monitoring—without touching the physical board until we are ready. Here’s what I need: • A reproducible simulation that mirrors Jet Nano’s CUDA-enabled GPU, memory constraints, and I/O. • Containerised tool-chain (PyTorch, TensorRT, cuDNN, etc.) with scripts that cover the full life-cycle: preprocessing, training, hyper-parameter sweeps, evaluation metrics, and a mock-deployment stage that tracks resource usage and latency. • Clear documentation so a...

For the next round of hiring I want an accomplished Senior Data Engineer to sit in on our technical interviews for roughly two hours each day. The role is purely evaluative: you will craft probing questions, join live video calls, and quickly score each candidate’s depth of knowledge across Python, Scala and SQL. Our stack centres on Azure and Databricks, so practical insight into large-scale Spark/PySpark jobs, data-model design, ETL orchestration and cloud performance tuning is essential. Candidates frequently discuss streaming, optimisation strategies and modern AI/ML add-ons, so any hands-on exposure to libraries such as PyTorch, NumPy, SciPy or TensorFlow will help you challenge them at the right level, though it is not mandatory. Availability is limited to two focused hou...

I am preparing to move a sizeable MySQL dataset—customer, product, and transaction records—to a new environment and need someone who has performed full-scale migrations before. The assignment runs for roughly one month, during which you will work from our Hyderabad office so we can iterate quickly with business owners and IT. The work covers the entire pipeline: extracting data from the current MySQL instance, scrubbing and de-duplicating it, mapping old structures to the target schema, and applying significant transformations to fit new business rules. Solid SQL is obviously essential, and you should already feel at home with large tables, indexes, constraints, and performance tuning. Experience scripting in Python or using ETL utilities (e.g., Talend, Pentaho, custom shell/P...

Job Title: Data Architect — Azure & Databricks Key Responsibilities Design and govern scalable data platforms using Azure and Databricks. Define end-to-end data architecture (ingestion, storage, processing, modeling, serving) based on Lakehouse and governance principles. Establish data modeling standards and architecture best practices. Architect and optimize data pipelines using Databricks, Delta Lake, and Azure Data Factory. Implement CI/CD and environment management using Databricks Asset Bundles and automation tools. Drive performance optimization across Spark, SQL, and Python workloads. Apply software engineering best practices (modular design, testing, CI/CD) to data solutions. Partner with business and analytics teams to translate requirements into scalable archit...

I’m assembling a small pool of Python specialists who can jump in as on-demand interviewers for my hiring pipeline. Every candidate you meet will be applying for a data-science-focused role, so I need someone whose own background is genuinely senior-level in that space—think daily work with pandas, NumPy, scikit-learn, Jupyter notebooks, model deployment, and the usual mix of statistics and SQL that glues real projects together. Your task is to run one-hour coding-test sessions over Zoom or Google Meet. I supply the shortlist of applicants and the calendar invites; you supply the technical depth and the objective scoring. During each session you will: • present or share a prepared data-centric coding challenge (I’m happy to reuse a problem you already trust, or...