Pega Genai 504 bad gateway Error

General
,
1

I am currently working on data extraction and trying to process a 12-page PDF document using a Pega GenAI Connect rule. However, the process consistently fails and returns a 504 Gateway Timeout error.

Is there any alternate way for data extraction in Pega?

2

I recommend to check the couple of things

  1. Are you able to extract from other documents(just to isolate the issue)?
  2. Confirm the model used for extraction. Ensure that you’re using the right model for your extraction.
  3. Confirm the size of the attachment. Couple of models has input token limitations
  4. Trace and check the exact error message you received

Could you please confirm if this is on Infinity 25 or 26 version?

3

Hi @RameshSangili

Currently, I am using Infinity 26.1 and the file size is 810KB. I tried with a different model, but the same error is coming. GenAI is not sending the response. During upload, the issue is coming.

4

Could yuo please check with other documents (to isolate this issue)? Since you’re talking about timeout, is the timeout happening at the LLM or Gateway? Can yu please run the tracer?

5

Hi @RameshSangili ,

here is the screenshot of error message

tmp_441187bd-8e29-41e0-8721-02e5f66a5586
tmp_441187bd-8e29-41e0-8721-02e5f66a5586867×480 19.3 KB

tmp_1ce662ed-7f30-46c0-8021-41e633cd962d
tmp_1ce662ed-7f30-46c0-8021-41e633cd962d1917×616 22.2 KB

When tried with different file it is working

6

How big is the attachment size?

7

Attachment size is of 800kb.

8

I would recommend to create a INC ticket to check wiht the SME’s. I’ve tested with multiple attachments and it worked fine.