On Your Data is now Generally Available in Azure OpenAI Service

This post has been republished via RSS; it originally appeared at: New blog articles in Microsoft Community Hub.

We're thrilled to announce the much-anticipated Azure OpenAI Service On Your Data is now generally available! The groundbreaking feature empowers you to leverage the power of OpenAI models, such as GPT-4, and incorporates the advanced capabilities of RAG (Retrieval Augmented Generation) model, directly on your data with enterprise-grade security on Azure. This cutting-edge capability transforms the way you connect, interact, and ground your data, with greater accuracy and speed through a user-friendly conversational experience. You can rapidly create personalized copilots with your data to enhance user comprehension, expedite task completion, and aid decision-making.



Unleashing the Power of Your Data 

Azure OpenAI Service On Your Data empowers you to unlock the full potential of your data effortlessly with enterprise-grade security. By directly running OpenAI models on your data, the requirement for extensive training is eliminated. Leveraging advanced AI capabilities such as GPT-4 allows you to streamline communication, enhance customer service, and increase productivity throughout your organization.


With Azure OpenAI Service On Your Data, you can achieve superior quality AI responses out-of-the-box as we have implemented precision prompt engineering and tuned various components such as intent extraction, search retrieval, filtering and re-ranking, data ingestion to deliver accurate, concise, and coherent responses optimized for each model.

Build a Copilot with the On Your Data feature

Capabilities Generally Available

Below is a range of general availability capabilities:

  • Enhanced Security for Enterprise: Access your private Azure resources on both Azure OpenAI Studio and APIs with private endpoints and VPN enabled for Azure AI Search, Azure OpenAI, and Azure Blob Storage (preview). With document-level access control, responses can be generated based on the documents a user can access.
  • Expanded Data Sources: Connect to your data from Azure AI Search and Azure Cosmos DB for MongoDB vCore, as well as the data sources in preview, including Azure Blob Storage, local files, URL/web address, etc. Stay tuned for more additions to the general availability list.
  • Incorporate RAG (Retrieval-Augmented Generation) for Intelligent Information Retrieval: Utilize the advanced capabilities of the RAG model to enhance the quality and relevance of information retrieval, enabling more context-aware and precise responses in your conversational experiences.
  • Customizable Responses and Parameters: Tailor your chat experience by limiting response and custom parameters, such as the strictness and number of documents retrieved.
  • Azure AI Vector and Hybrid Search: Achieve more precise data retrieval with vector or hybrid search  from Azure AI Search, refining the insights you gather from your data.
  • Semantic Search as a Default: Enjoy more context-aware and relevant results using the Semantic Search by default.
  • OpenAI Models Availability: Get access to OpenAI GPT-35-Turbo, GPT-35-Turbo-16k, GPT-4, GPT-4-32k models.
  • Private Endpoints & VPNs:
  • Document-level Access Control: Boost security by limiting access to documents based on Microsoft Entra ID when generating responses.
  • Effortless and Swift Deployment: Seamless and rapid deployment to a web application or a copilot in the Copilot Studio (preview).
  • Search Filter (API): Customize your searches and add context with the retrieval augmented generation (RAG) model on specific parts of our API.
  • Updated SDK: Streamline integration with your systems using our improved SDK, harnessing the power of Azure OpenAI On Your Data.
  • Supported File Types: .txt., .pdf, .docx, .pptx, .md, .html


Customer Use Cases and Benefits

Azure OpenAI Service On Your Data offers multiple customer benefits. It boosts productivity in both B2C and B2B interactions, enables data analysis for insights and industry knowledge, and positively influences productivity, cost savings, and decision-making. This can contribute to your business thriving in today's dynamic market.

Use Cases


Automated Customer Assistance

Provide quick responses to frequently asked questions and guide users through common troubleshooting steps based on the customers’ data.

Real-time Document Search

Provide real-time support to product specifications and guide users through common troubleshooting steps based on product manuals

Citizen Service

Provide quick responses to frequently asked public service questions and guide users through specific steps based on citizen service support

Learning Assistant

Offer explanations and examples to help users understand academic concepts or learn new skills based on specific curricula

Legal Review

Quick access to legal insights from existing and upcoming legislation to properly advise clients

Marketing Insights

Tap into internal and external resources to respond to internal and external marketing inquiries

Software Development

Generate sample code based on the customer’s needs

HR Support

Provide quick responses to frequently asked HR questions based on the customers’ HR policy

Industry/Competitive Insights

Tap into publicly available resources to gain insights on the industry and competitors 

Health Advice

Provide general information on symptoms, first aid, or healthy living.

Predictive Maintenance

Provide predictive maintenance and customer support based on customer’s historic data

Customer Inspiration

Built on Azure OpenAI Service, Young Williams' Priya bot transforms customer service and case management within government agencies. Priya provides round-the-clock assistance, addressing inquiries with realism and empathy, effectively reduces the burden on busy call centers while maintaining seamless human-like interaction. Try Priya firsthand.


“I'm thrilled about the partnerships we have with multiple states where we leveraged the On Your Data feature of Azure OpenAI Service. The Priya bot is changing how public agencies serve citizens, offering round-the-clock, empathetic assistance and easing call center loads. This collaboration highlights the impact of generative AI in improving government responsiveness and efficiency. We're excited to keep pushing the boundaries of public service innovation.” – Rob Wells, CEO of Young Williams


Priya by Young Williams for the State of Louisiana

Kick-start Your Journey with Azure OpenAI Service On Your Data

Begin your venture with Azure OpenAI Service On Your Data - a groundbreaking technology designed to revolutionize how you connect and interact with your enterprise data. Transition your data insights into a powerful lever to boost your business performance. Utilize the compelling force of conversational AI with Azure OpenAI Service. Join us in this journey and start experiencing the transformative benefits for your business today.




Leave a Reply

Your email address will not be published. Required fields are marked *


This site uses Akismet to reduce spam. Learn how your comment data is processed.