Mahbub Ul Haq Research Centre , LUMS
Terms of Reference (ToR) - Receipt Reporting System
Mahbub Ul Haq Research Centre , LUMS
136 views
Posted date 4th March, 2025 Last date to apply 4th April, 2025
Country Pakistan Locations Lahore, Islamabad, Peshawar
Category Consultancy
Type Consultancy

Background
We are seeking a skilled firm to build a Receipt Reporting System that will process receipt images, extract key data using OCR, match it with a master database, and send automated notifications. The system should also provide a fallback for manual data entry when OCR fails.

2. Scope of Work

The firm will be responsible for designing and implementing the system architecture, integrating APIs, setting up a database, and ensuring efficient data processing and automation.

2.1 System Components

1. WhatsApp Integration

  • Users will submit receipts via WhatsApp.
  • A QR code will be provided for easy chat access.
  • Integration with WhatsApp API (Twilio / Meta Cloud API) to receive messages.

2. OCR & Image Processing

  • The system should extract text from receipts using Google Vision API or an equivalent OCR tool.
  • The OCR should handle both printed and handwritten receipts.
  • In case of failure, users will be notified and redirected to a manual data entry form.

3. Database Management

  • Store receipt details (date, items, amount, vendor, etc.) in PostgreSQL / MySQL.
  • Store and match extracted data with a master database.
  • Implement indexing for efficient search and retrieval.

4. Data Matching & Validation

  • Compare extracted receipt data with the master database.
  • If a match is found, send a confirmation message via WhatsApp.
  • If no match is found, notify the user and log the discrepancy.

5. Automation & Error Handling

  • Implement workflows to handle OCR failures and missing data.
  • Send automated WhatsApp messages for successful/unsuccessful processing.
  • Provide a web-based form for manual receipt entry if OCR fails.

6. Security & Compliance

  • Ensure data privacy compliance with GDPR and local regulations.
  • Encrypt sensitive data in storage and transmission.
  • Implement role-based access control (RBAC) for database security.

3. Required Skills & Experience

The ideal firm should have expertise in:

  • Backend Development - Strong experience with Python (Flask/FastAPI) or Node.js (Express.js).
  • API Integration - Familiarity with WhatsApp API (Twilio / Meta Cloud API) and integration of APIs in general.
  • OCR & Image Processing - Experience in handling both printed and handwritten text recognition tools (Familiarity with anyne of the OCR APIs .i.e Google Vision API, Cloud API, AWS Textract, Microsoft Azure Computer Vision API, MyScript, or Tesseract OCR)
  • Database Management - Proficiency in PostgreSQL / MySQL for structured data storage and retrieval.
  • Automation & Cloud Deployment - Knowledge of AWS, GCP, or Firebase for scalable hosting.
  • Error Handling & Manual Data Entry- Ability to implement fallback mechanisms such as web forms for manual input.
  • Security & Compliance- Ensuring data privacy and security best practices.

4. System Development Steps

4.1 Planning & Requirement Analysis

  • Finalize system requirements.
  • Define use cases and user flow.
  • Select appropriate tech stack and APIs.

4.2 WhatsApp Integration

  • Register and configure a WhatsApp Business API account.
  • Set up Twilio / Meta Cloud API to receive and process messages.
  • Implement QR code-based chat initiation.

4.3 OCR & Image Processing Setup

  • Integrate Google Vision API / Handwritten Text APIs.
  • Test with printed and handwritten receipt samples.
  • Optimize OCR processing speed and accuracy.

4.4 Database & Data Matching

  • Design a relational database schema.
  • Store receipts and extracted data.
  • Implement matching algorithms to compare with the master database.

4.5 Automation & Notifications

  • Develop automated workflows for OCR success/failure.
  • Set up WhatsApp messaging for user notifications.
  • Implement a manual entry fallback via a web form.

4.6 Testing & Deployment

  • Conduct unit, integration, and user acceptance testing (UAT).
  • Deploy on AWS/GCP/Firebase.
  • Monitor system performance and error logs.

5. Expected Deliverables

The developer should deliver:

  • A functional backend system for processing receipt data.
  • API integrations for WhatsApp messaging and OCR.
  • A structured database with efficient data retrieval.
  • Error handling mechanisms including manual entry forms.
  • Deployment documentation and basic user guidance.

6. Reporting & Payment

  • The developer will provide weekly progress updates.
  • Payments will be structured based on milestone achievements.
  • Budget and contract details will be discussed based on expertise and project scope.

7. Application Process

Interested firm should submit:

  • A technical proposal outlining their approach.
  • A portfolio showcasing relevant projects.
  • Their availability and expected compensation.

Apply By:

Interested Firms can submitt their Technical and Financial proposal at [email protected]

Search