What was the goal?
A global professional education content provider, offering over 100 designations and courses, faced mounting pressure to meet the growing demand for fresh assessment content. Despite a sizable team of experts, they struggled to produce enough high-quality assessment items to support their expanding course offerings and meet customer needs. Reliance on expensive contractors and third-party writers further complicated their content creation process.
Industria was tasked with developing a solution that would:
- Scale assessment item production while maintaining educational quality and alignment.
- Reduce dependency on external contractors and mitigate associated costs.
- Ensure consistency in item quality across various courses and designations.
- Seamlessly integrate with existing workflows and tools.
- Enhance the overall learning experience for students through improved assessment content.
"Our team was stretched thin trying to meet the demand for fresh, high-quality assessment items across our expanding course catalog. We needed a solution that could scale our production without compromising on educational value or burdening our internal resources." - Head of AI Content Development
Solution:
Industria Studio engineered a comprehensive GenAI system tailored to the client's assessment creation needs:
- Content analysis & model fine-tuning: Analyzing extensive course content, student profiles, and existing assessment items informed the fine-tuning of an LLM, creating a highly accurate model with tailored relevance for the client's unique needs.
- LLM system architecture: Based on the fine-tuned model, a robust 5-step workflow was designed. This process encompasses course material retrieval, item generation, validation, editing, and quality review.
- System assembly: Implementing this architecture combined low-code solutions and LLM-assisted development. This approach enabled rapid iteration and efficient system construction.
- User interface: Harnessing the system's capabilities, a custom interface was developed featuring an item generation panel, item bank, and export process compatible with providers like Surpass. This interface supports team-wide use, streamlines item creation, and enhances assessment item management.
- Custom content scraper: Developing a tailored scraper integrated into a Chrome extension allowed easy extraction of up-to-date course data directly from the student view, ensuring the highest quality and most current content for item generation.
- Workflow integration: The system was seamlessly integrated into the client's existing tools and platforms, minimizing disruption to established processes.
- Quality assurance: Implementing an AI-assisted review process flagged potential issues and inconsistencies, allowing human experts to focus on high-level quality control and educational alignment.
Results:
The implementation of Industria's GenAI system yielded significant improvements in the client's assessment item production:
- Increased assessment item production by 300%, meeting growing demand across 125+ designations and courses.
- Reduced dependency on external contractors resulting in $350k yearly savings.
- Improved consistency and quality of assessment items across all courses.
- Significantly enhanced the learning experience for students through more diverse and aligned assessment content.
Summing up
This project showcases Industria Studio's ability to create tailored GenAI solutions for complex educational content creation workflows. By automating and enhancing the assessment item generation process, we enabled the client to meet increasing demand for high-quality, educationally aligned content while improving scalability and reducing costs.
Our results demonstrate the potential of GenAI in revolutionizing assessment content creation. This approach can benefit any organization in the education sector, from professional training providers to academic institutions, enabling them to scale their assessment offerings efficiently without compromising on educational quality or alignment with learning objectives.
