Big Data Backend, RDS SQL Server & API Integration Engineer Full Time

Experience: 2-6 Years

Number of Openings: 2

Location: Bhubaneswar, Odisha

Work Type: Onsite/Hybrid/Remote

Job Summary:

Ishvara Tech Consulting Pvt Ltd is seeking a hands-on Big Data Backend, RDS SQL Server & API Integration Engineer to own the data backbone for Leadnova.ai and other data-led platforms.

The role goes beyond routine database administration. The selected resource must manage large structured datasets, optimize AWS RDS SQL Server and MySQL environments, build secure backend APIs, connect internal and third-party applications, integrate external data sources, and support validation/enrichment workflows for email, phone, company and contact records.

Role Focus:

• 70% Backend/API/Data Engineering: Build APIs, data workflows, ingestion pipelines, validation flows, integration connectors and background jobs.

• 20% Database Development & Administration: Manage SQL Server/RDS, MySQL, schema design, indexing, partitioning, query tuning, data storage and performance.

• 10% Cloud, Monitoring & Reliability: Support AWS services, logging, alerts, security, backups, queues and operational stability.

Key Responsibilities:

• Database Administration & Development: Manage AWS RDS SQL Server, SQL Server 2016/2019/2022 and MySQL databases; maintain schemas, tables, indexes, stored procedures, views and data structures.

• Big Data Handling: Work with high-volume structured datasets used for lead search, prospecting, filtering, exports, CRM sync, analytics and campaign preparation.

• Performance Optimization: Tune queries, execution plans, indexes, partitions, stored procedures, pagination and batch operations to ensure faster retrieval from large tables.

• Backend API Development: Design and develop REST APIs for prospect finder, lead search, advanced filters, validation, enrichment, export/download, contact lists, campaign modules and admin workflows.

• Internal & Third-Party Integrations: Build APIs and connectors to integrate internal applications, CRM systems, external data providers, validation vendors and enrichment services.

• Fresh Data Ingestion: Create processes to bring in fresh data from approved third-party sources, normalize it, map it to internal schemas and make it available to application modules.

• Email & Phone Validation: Integrate validation APIs for syntax, domain, MX/SMTP, deliverability, disposable email, catch-all, phone format, country code, carrier and line type checks.

• Data Cleaning & Deduplication: Implement matching, deduplication, suppression, invalid-record flagging, normalization and data quality scoring workflows.

• Background Jobs & Queues: Use Redis, BullMQ, AWS SQS or worker pools for bulk imports, exports, validation, enrichment, scheduled refreshes, retries and failed-job handling.

• Security & Access Control: Implement JWT/OAuth2-based security, RBAC, API rate limiting, input validation, audit logs, data masking and secure credential management.

• Monitoring & Troubleshooting: Monitor database health, slow queries, API errors, queue failures, third-party API failures and infrastructure events using AWS CloudWatch and related tools.

• Documentation & Collaboration: Maintain data dictionaries, API documentation, Postman collections, Swagger/OpenAPI specs and work closely with frontend, AI, QA, DevOps and product teams.

Technical Skills:

• Database Technologies: AWS RDS SQL Server, Microsoft SQL Server 2016/2019/2022, MySQL, relational database design and large table management.

• SQL Development: T-SQL, stored procedures, functions, views, triggers, execution plans, Query Store, dynamic SQL, SQL Profiler, Extended Events and DMV queries.

• Indexing & Search Optimization: Clustered, Non-Clustered, Columnstore and Full-Text indexes; partitioning, sharding concepts, pagination and efficient data retrieval.

• Backend Development: Node.js with Express.js/NestJS or similar backend frameworks; REST APIs, JSON, API versioning, request/response schema design and error handling.

• ORM & Query Tools: Sequelize, Prisma, TypeORM, Knex.js or strong direct SQL query handling.

• API Security: JWT, OAuth2, RBAC, API keys, rate limiting, throttling, IP whitelisting and secure request validation.

• Data Integration: Third-party API integration, webhook handling, scheduled sync, retry logic, fallback handling, vendor rate-limit management and API usage logging.

• Data Processing: Bulk Insert, BCP, SSIS/ETL awareness, data migration, import/export pipelines, deduplication, normalization and validation workflows.

• Queues & Async Processing: Redis, BullMQ, AWS SQS, worker jobs, cron jobs, dead-letter queues and batch processing.

• Cloud & DevOps: AWS RDS, EC2, S3, CloudWatch, Secrets Manager, Lambda, SQS, CI/CD for database/backend deployments and basic Jenkins/Bitbucket Actions knowledge.

• Security & Compliance: Encryption, data masking, row-level security, audit logs, GDPR/CAN-SPAM awareness and secure handling of contact/business data.

Preferred Qualification:

• Experience with multi-terabyte or very large structured databases and distributed database architecture.

• Experience in lead databases, CRM systems, marketing automation platforms, sales intelligence platforms or data marketplace products.

• Experience with email validation, SMTP/MX checks, domain verification, bounce handling and deliverability-related data flows.

• Experience with phone validation, contact enrichment, company enrichment and data freshness pipelines.

• Knowledge of Elasticsearch, OpenSearch, Meilisearch or similar search technologies will be an added advantage.

• Knowledge of Redis caching, data lake concepts, AWS Redshift or analytics workloads will be preferred.

• Ability to work in a fast-paced, product-driven environment with immediate ownership expectations.

Immediate Priorities:

Within the first 30-45 days, the candidate should be able to:

• Review the current database structure, AWS RDS SQL Server setup and MySQL usage.

• Identify slow queries, missing indexes, API bottlenecks and high-risk database areas.

• Prepare or update the data dictionary, table mapping and API-to-database mapping.

• Improve or build APIs for prospect finder, search filters, validation, enrichment, export/download and CRM sync.

• Review third-party validation/enrichment integrations and recommend improvements for reliability and cost control.

• Implement or improve data freshness, deduplication, logging, retry and failure-tracking processes.

• Coordinate with frontend, AI, QA and DevOps teams to make data available securely and efficiently.

Interview Assessment Areas:

• SQL query writing, execution plan reading and performance tuning.

• Schema design for company/contact/lead datasets and large searchable tables.

• Indexing, partitioning, pagination and faster data retrieval strategy.

• REST API design for search, filters, export, validation and enrichment workflows.

• Third-party API integration, rate-limit handling, retry logic and error handling.

• Bulk data import/export and queue-based background processing.

• Data deduplication, validation, normalization and quality scoring approach.

• Security, RBAC, audit logs, sensitive-data protection and API access control.

• Troubleshooting slow APIs, failed imports, broken integrations and database connection issues.

Education:

• Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering or equivalent practical experience.

• Hands-on experience with databases, backend APIs and integrations will be given higher weight than degree alone.

Why Join Us:

High-ownership role on Ishvara Tech’s large-scale AI/data platform.