A Monitor configures a product search, its schedule, automation settings, and what teams get to screen and QC results.
In MLM-AI, a Monitor defines the product search and how results will be screened. In a monitor you define:
- The search terms to include in the query (ex: product name and relevant synonyms)
- What literature databases to search
- How often should results be produced (weekly, daily, or on demand)
- Permissions: what teams will perform reviews
- Notification and automation to be carried out by MLM-AI
Watch the walk through below to learn more about configuring search strategies in MLM-AI using Monitors:
To create a new monitor, click "+ Add Monitor" from the Monitors menu.
Click - Add Monitor button
Alternatively chose to Copy the definitions from an existing monitor if you wish to replicate existing configuration settings.
Give your new monitor a name: e.g. Oxytocin
A new setup page open once you click on Add Monitor
To add search terms just enter the product name or compound in the keyword or compound field.
This will auto-populate a list of synonyms to choose from in the box below titled Available synonyms.
You can select the synonyms from the list or click on select all. After that click on "Add Selected".
Your selected terms will appear in the "Chosen Search Terms" box. Items in this list will be searched as an OR-based search strategy.
Click "🔍Preview Results" to run the search in the MLM-AI database. This will let you browse results and estimate the expected volume of hits.
Additional relevant terms can be added to a monitor in the "User Defined Keyterms" section. Use this feature to create additional highlights that facilitate screening. For example: terms of interest (symptoms, concomitant medications) relevant to particular products
Select the "Apply user defined keyterms" checkbox to enable the keywords list. Terms can be added one at a time or by copy/pasting a list using "Multi-Line"
The MLM-AI Database ingests data from various literature sources daily, including repositories of global reach (PubMed, Crossref, DOAJ) complemented by various regional repositories.
Select which ones to use when searching with this monitor as shown below.
You can also customize search schedule the Monitors to run periodically (weekly or daily) or on demand. When a monitor runs on a schedule, "Day Zero" is the weekday when results will be produced (if monitor runs weekly). "ETA for Completion" specifies a number of days expected for screening completion.
Monitor repositories and schedule configuration
This section assigns teams to screening stages, giving users permissions to update decisions on incoming abstracts.
Teams can be assigned the following roles in a monitor:
- Abstract Review - members of teams in this role can add screening decisions
- Quality Review - members in this role can add or update other user's decisions.
The Quality Review role is assigned to teams in charge of "QC" activities. Multiple teams can be assigned to either Abstract Review or Quality Review roles.
Team Assignment and Workflow - Review Settings
Special Situations and Exclusions
When users save decisions, they can select categories for exclusions and special situations. The selections are multi-choice and come pre-populated with values typical for ICSR screening.
The values can be configured per your workflow: existing entries can be removed and customized as needed.
Workflow - Review Settings
Additional settings control monitor behavior on automatic screening and date searches
For high volume screening workloads, users can configure automated screening based on AI tags. Pre-screened results receive a corresponding exclusion and are always available in MLM-AI Review details for inspection.
- When more than one INCLUSION setting is used together, MLM-AI will accept any of the chosen criteria for inclusion.
The following settings control how dates are applied on search results:
- Include abstracts found by publication date - retrieve abstracts where the publication date matches the selected date range of the review. This option is on by default and helps maintain correspondence to existing manual search strategies.
- Discard publication dates older than 60 days - if the difference of an article first seen date and publication date is older than 60 days, results are discarded. This option is useful to avoid spurious results from re-publication of journals going back many years.
Monitors support a number of notification options that let users:
- Be notified when a review is ready for screening, or when its status changes (ex: from In Progress to Completed)
- Be notified of any assessment updates, when they are part of an assessment (per the article audit log)
- Send the details of an abstract and its assessments to a pre-configured list of recipients