Any pointer where to look for the cause of "NetworkError: 400 Bad Request - https://..." when creating a new WI of a specific type ?
After upgrade from RTC 4.0.3 to 4.0.6: Symptoms as described in Jazz Forum question 163394; when create a new WI, or open an existing one, of type Story_xxxx, using WF ScopeItem, on webUI only:
Submitted [PMR 55525,49R,000] , monitored browsers with FireBug, HTTPwatch, and Chrome Inspect element as advised: All reports pointed to a "NetworkError: 400 Bad Request" evry time a new WI (of the specific type with the specific WF) is created or an existing one is opened.
Have since created a brand new PA, with the process template cloned from the troublesome PA, the issues can be produced at will with creation of new WI of ther particular type.
SWAT spotted miss-configured non-Attribute-Based boolean fields, they have since been fixed. but the issues and error 400 persisted.
On the brand new PA, we can also reproduce the same error when just switch to the PA on webUI. None of the issues are experienced on the Eclipse-based clients. Any idea where we and SWAT should be looking. Anything like the JSESSIONID issue posted on Jazz Forum question 161232 (after upgrade from 4.0.5 to 4.0.7).
Error 400, via Firebug, when switch to the PA on webUI:
"NetworkError: 400 Bad Request - https://<RTCserver:port>/ccm/service/com.ibm.team.apt.internal.service.rest.IPlanRestService/planSearchResults2?currentOnly=true&maxResults=10&startIndex=0&includeTeamLoad=true&includeTeamLoadAdditionalInfo=true&includeReferencedItems=true&projectAreaId=_YJAF8EiBEeSpbcN7TUEUxw&relationshipType=relatedToDevLine&relatedItemId=_YdYagEiBEeS5H58oyG02WA&_t=_FoogsD5-EeS5H58oyG02WA"
planSea...oyG02WA
_______________________________________________________________
[object Object]
_6()?includ...e=en-us (line 2485)
_6()?includ...e=en-us (line 6183)
_13()?includ...e=en-us (line 6198)
Error 400, via Firebug, when a new WI is created on webUI:
"NetworkError: 400 Bad Request - https://<RTCserver:port>/ccm/service/com.ibm.team.workitem.common.internal.rest.IWorkItemRestService/allValues?projectAreaItemId=_YJAF8EiBEeSpbcN7TUEUxw&typeId=common_library_story&includeArchived=false&ids=workItemType&ids=category&ids=target_release&ids=delta_st&ids=related_delta_state&ids=california_deviation&ids=project&ids=dcs_only_checkbox&ids=forms&ids=light_story&ids=placeholder&ids=production_patch&ids=development_requested&ids=conversion&ids=test_only&ids=component&ids=internalTags&ids=owner&ids=responsible_for&ids=authored_by&ids=target&ids=t-shirt_estimate&ids=com.ibm.team.apt.attribute.complexity&ids=qa_story_points&ids=dcs_story_points&ids=tp_status&ids=top_10_functionality_dependent&ids=executive_priority&ids=epic&ids=feature_area&ids=use_case&ids=impacted_state_-_az&ids=impacted_state_-_ca&ids=impacted_state_-_ccl&ids=impacted_state_-_cl&ids=impacted_state_-_co&ids=impacted_state_-_ct&ids=impacted_state_-_dc&ids=impacted_state_-_de&ids=impacted_state_-_id&ids=impacted_state_-_in&ids=impacted_state_-_ks&ids=impacted_state_-_ky&ids=impacted_state_-_md&ids=impacted_state_-_mt&ids=impacted_state_-_nj&ids=impacted_state_-_nv&ids=impacted_state_-_ny&ids=impacted_state_-_oh&ids=impacted_state_-_ok&ids=impacted_state_-_or&ids=impacted_state_-_pa&ids=impacted_state_-_sd&ids=impacted_state_-_ut&ids=impacted_state_-_va&ids=impacted_state_-_wv&ids=impacted_state_-_wy&ids=requirements_type&ids=product&ids=u_w&ids=fts&ids=claims&ids=accounting&ids=agency_mgmt&ids=qa_target_build&ids=priority_group&ids=delivery_risk&ids=qa_delivery_risk_impact&ids=design_tasks_created&ids=review_tasks_created&ids=development_tasks_created&ids=test_tasks_created&ids=dcs_tasks_created&ids=batch_job_update_tasks_created&ids=development_team&ids=target_sprint&ids=duplicate_bug_in_rtc&ids=insert_rank&ids=rank&ids=sprint_rank&ids=pit_build_compete&ids=sit_build_complete&ids=build_label_pick&ids=pit_build_label_enum&ids=prod_build_label&ids=group_ownership&ids=approved_for_development&ids=unified_business_backlog&ids=implementation_group&ids=impacted_area_billing_payment&ids=impacted_area_cancel&ids=impacted_area_forms_documents&ids=impacted_area_integration&ids=impacted_area_mid_term_changes&ids=impacted_area_new_business&ids=impacted_area_rating&ids=impacted_area_reinstate&ids=impacted_area_renewals&ids=impacted_area_reporting&ids=impacted_area_rewrite&ids=lockdown&ids=original_scope_state&ids=scope_control&ids=final_scope_control_enum&ids=original_scope_PAS12&ids=release_deadline_scope_PAS12&ids=added_to_scope_PAS12&ids=final_scope_PAS12&ids=removed_from_scope_PAS12&ids=req_delivered_PAS12&ids=req_non_delivered_PAS12&ids=delivered_PAS12&ids=not_delivered_PAS12&ids=non_delivery_reason_PAS12&ids=target_sprint_PAS12&ids=fixed_inadvertently_PAS12&ids=original_scope_PAS11&ids=release_deadline_scope_PAS11&ids=added_to_scope_PAS11&ids=final_scope_PAS11&ids=removed_from_scope_PAS11&ids=req_delivered_PAS11&ids=req_non_delivered_PAS11&ids=delivered_PAS11&ids=not_delivered_PAS11&ids=non_delivery_reason_PAS11&ids=target_sprint_PAS11&ids=fixed_inadvertently_PAS11&ids=original_scope_PAS10&ids=release_deadline_scope_PAS10&ids=added_to_scope_PAS10&ids=final_scope_PAS10&ids=removed_from_scope_PAS10&ids=req_delivered_PAS10&ids=req_non_delivered_PAS10&ids=delivered_PAS10&ids=not_delivered_PAS10&ids=non_delivery_reason_PAS10&ids=target_sprint_PAS10&ids=fixed_inadvertently_PAS10&ids=original_scope_PAS9&ids=release_deadline_scope_PAS9&ids=added_to_scope_PAS9&ids=final_scope_PAS9&ids=removed_from_scope_PAS9&ids=req_delivered_PAS9&ids=req_non_delivered_PAS9&ids=delivered_PAS9&ids=not_delivered_PAS9&ids=non_delivery_reason_PAS9&ids=target_sprint_PAS9&ids=fixed_inadvertently_PAS9&ids=original_scope_PAS8&ids=release_deadline_scope_PAS8&ids=added_to_scope_PAS8&ids=final_scope_PAS8&ids=removed_from_scope_PAS8&ids=req_delivered_PAS8&ids=req_non_delivered_PAS8&ids=delivered_PAS8&ids=not_delivered_PAS8&ids=non_delivery_reason_PAS8&ids=target_sprint_PAS8&ids=fixed_inadvertently_PAS8&ids=original_scope_PAS7&ids=release_deadline_scope_PAS7&ids=added_to_scope_PAS7&ids=final_scope_PAS7&ids=removed_from_scope_PAS7&ids=req_delivered_PAS7&ids=req_non_delivered_PAS7&ids=delivered_PAS7&ids=not_delivered_PAS7&ids=non_delivery_reason_PAS7&ids=target_sprint_PAS7&ids=fixed_inadvertently_PAS7&ids=original_scope_PAS6&ids=release_deadline_scope_PAS6&ids=added_to_scope_PAS6&ids=final_scope_PAS6&ids=removed_from_scope_PAS6&ids=req_delivered_PAS6&ids=req_non_delivered_PAS6&ids=delivered_PAS6&ids=not_delivered_PAS6&ids=non_delivery_reason_PAS6&ids=target_sprint_PAS6&ids=fixed_inadvertently_PAS6&ids=original_scope_PAS5&ids=release_deadline_scope_PAS5&ids=added_to_scope_PAS5&ids=final_scope_PAS5&ids=removed_from_scope_PAS5&ids=req_delivered_PAS5&ids=req_non_delivered_PAS5&ids=delivered_PAS5&ids=not_delivered_PAS5&ids=non_delivery_reason_PAS5&ids=target_sprint_PAS5&ids=fixed_inadvertently_PAS5&ids=original_scope_pas4&ids=release_deadline_scope_pas4&ids=added_to_scope_pas4&ids=final_scope_pas4&ids=removed_from_scope_pas4&ids=req_delivered_pas4&ids=req_non_delivered_pas4&ids=delivered_pas4&ids=not_delivered_pas4&ids=non_delivery_reason_pas4&ids=target_sprint_pas4&ids=fixed_inadvertently_pas4&ids=original_scope_pas3&ids=release_deadline_scope_pas3&ids=added_to_scope_pas3&ids=final_scope_pas3&ids=removed_from_scope_pas3&ids=req_delivered_pas3&ids=req_non_delivered_pas3&ids=delivered_pas3&ids=not_delivered_pas3&ids=non_delivery_reason_pas3&ids=target_sprint_pas3&ids=fixed_inadvertently_pas3&ids=original_scope_pas2&ids=release_deadline_scope_pas2&ids=added_to_scope_pas2&ids=final_scope_pas2&ids=removed_from_scope_pas2&ids=req_delivered_pas2&ids=req_non_delivered_pas2&ids=delivered_pas2&ids=not_delivered_pas2&ids=non_delivery_reason_pas&ids=target_sprint_pas2&ids=fixed_inadvertently_pas2&ids=original_scope_ps_9&ids=release_deadline_scope_ps_9&ids=added_to_scope_ps_9&ids=final_scope_ps_9&ids=removed_from_scope_ps_9&ids=req_delivered_pas1&ids=req_non_delivered_pas1&ids=delivered_ps_9&ids=not_delivered_ps_9&ids=non-delivery_reason_ps_9&ids=target_sprint_ps_9&ids=fixed_inadvertently_ps_9&ids=original_scope_PS_8&ids=release_deadline_scope_ps_8&ids=added_to_scope_PS_8&ids=final_scope_PS_8&ids=remove_from_scope_ps_8&ids=req_delivered_ps8&ids=req_non_delivered_ps8&ids=delivered_ps_8&ids=not_delivered_ps_8&ids=non-delivery_reason_ps_8&ids=target_sprint_ps_8&ids=fixed_inadvertently_ps_8&ids=original_scope_PS_7&ids=release_deadline_scope_ps_7&ids=added_to_scope_PS_7&ids=final_scope_PS_7&ids=remove_from_scope_ps_7&ids=req_delivered_ps7&ids=req_non_delivered_ps7&ids=delivered_ps_7&ids=not_delivered_ps_7&ids=non-delivery_reason_ps_7&ids=target_sprint_ps_7&ids=fixed_inadvertently_ps_7&ids=original_scope_PS_6&ids=release_deadline_scope_ps_6&ids=added_to_scope_PS_6&ids=final_scope_PS_6&ids=remove_from_scope_ps_6&ids=req_delivered_ps6&ids=req_non_delivered_ps6&ids=delivered_ps_6&ids=not_delivered_ps_6&ids=non-delivery_reason_ps_6&ids=target_sprint_ps_6&ids=fixed_inadvertently_ps_6&ids=original_scope_PS_5&ids=release_deadline_scope_ps_5&ids=added_to_scope_PS_5&ids=final_scope_PS_5&ids=remove_from_scope_ps_5&ids=req_delivered_ps5&ids=req_non_delivered_ps5&ids=delivered_ps_5&ids=not_delivered_ps_5&ids=non-delivery_reason_ps_5&ids=target_sprint_ps_5&ids=fixed_inadvertently_ps_5&ids=original_scope_PS_4&ids=release_deadline_scope_ps_4&ids=added_to_scope_PS_4&ids=final_scope_PS_4&ids=remove_from_scope_ps_4&ids=req_delivered_ps4&ids=req_non_delivered_ps4&ids=delivered_ps_4&ids=not_delivered_ps_4&ids=non-delivery_reason_ps_4&ids=target_sprint_ps_4&ids=fixed_inadvertently_ps_4&ids=original_scope_PS3&ids=release_deadline_scope_ps_3&ids=added_to_scope_PS_3&ids=final_scope_PS_3&ids=remove_from_scope_ps_3&ids=req_delivered_ps3&ids=req_non_delivered_ps3&ids=delivered_ps_3&ids=not_delivered_ps_3&ids=non-delivery_reason&ids=target_sprint_ps_3&ids=fixed_inadvertently&ids=original_scope_PAS5_1&ids=release_deadline_scope_PAS5_1&ids=added_to_scope_PAS5_1&ids=final_scope_PAS5_1&ids=removed_from_scope_PAS5_1&ids=req_delivered_PAS5_1&ids=req_non_delivered_PAS5_1&ids=delivered_PAS5_1&ids=not_delivered_PAS5_1&ids=non_delivery_reason_PAS5_1&ids=target_sprint_PAS5_1&ids=fixed_inadvertently_PAS5_1&ids=original_scope_PAS4_1&ids=release_deadline_scope_PAS4_1&ids=added_to_scope_PAS4_1&ids=final_scope_PAS4_1&ids=removed_from_scope_PAS4_1&ids=req_delivered_PAS4_1&ids=req_non_delivered_PAS4_1&ids=delivered_PAS4_1&ids=not_delivered_PAS4_1&ids=non_delivery_reason_PAS4_1&ids=target_sprint_PAS4_1&ids=fixed_inadvertently_PAS4_1&ids=original_scope_PAS3_1&ids=release_deadline_scope_PAS3_1&ids=added_to_scope_PAS3_1&ids=final_scope_PAS3_1&ids=removed_from_scope_PAS3_1&ids=req_delivered_PAS3_1&ids=req_non_delivered_PAS3_1&ids=delivered_PAS3_1&ids=not_delivered_PAS3_1&ids=non_delivery_reason_PAS3_1&ids=target_sprint_PAS3_1&ids=fixed_inadvertently_PAS3_1&ids=original_scope_pas2.1&ids=release_deadline_scope_pas2.1&ids=added_to_scope_pas2.1&ids=final_scope_pas2.1&ids=removed_from_scope_pas2.1&ids=req_delivered_pas2.1&ids=req_non_delivered_pas2.1&ids=dev_delivered_to_qa_pas2.1&ids=dev_non_delivered_to_qa_pas2.1&ids=non-delivery_reason_pas2.1&ids=target_sprint_pas2.1&ids=fixed_inadvertently_pas2.1&ids=original_scope_pas1.2&ids=release_deadline_scope_pas1.2&ids=added_to_scope_pas1.2&ids=final_scope_pas1.2&ids=removed_from_scope_pas1.2&ids=req_delivered_pas1.2&ids=req_non_delivered_pas1.2&ids=dev_delivered_to_qa_pas1.2&ids=dev_non_delivered_to_qa_pas1.2&ids=non-delivery_reason_pas1.2&ids=target_sprint_pas1.2&ids=fixed_inadvertently_pas1.2&ids=original_scope_pas1.1&ids=release_deadline_scope_pas1.1&ids=added_to_scope_pas1.1&ids=final_scope_pas1.1&ids=removed_from_scope_pas1.1&ids=req_delivered_pas1.1&ids=req_non_delivered_pas1.1&ids=dev_delivered_to_qa_pas1.1&ids=dev_non_delivered_to_qa_pas1.1&ids=non-delivery_reason_pas1.1&ids=target_sprint_pas1.1&ids=fixed_inadvertently_pas1.1&ids=original_scope_ps8.3&ids=release_deadline_scope_ps8.3&ids=added_to_scope_ps8.3&ids=final_scope_ps8.3&ids=removed_from_scope_ps8.3&ids=req_delivered_ps8.3&ids=req_non_delivered_ps8.3&ids=dev_delivered_to_qa_ps8.3&ids=dev_non_delivered_to_qa_ps8.3&ids=non-delivery_reason_ps8.3&ids=target_sprint_ps8.3&ids=fixed_inadvertently_ps8.3&ids=original_scope_ps8.2&ids=release_deadline_scope_ps8.2&ids=added_to_scope_ps8.2&ids=final_scope_ps8.2&ids=removed_from_scope_ps8.2&ids=req_delivered_ps8.2&ids=req_non_delivered_ps8.2&ids=dev_delivered_to_qa_ps8.2&ids=dev_non_delivered_to_qa_p8.2&ids=non-delivery_reason_ps8.2&ids=target_sprint_ps8_2&ids=fixed_inadvertently_ps8.2&ids=original_scope_ps8.1&ids=release_deadline_scope_PS8.1&ids=added_to_scope_ps8.1&ids=final_scope_ps8.1&ids=removed_from_scope_ps8.1&ids=req_delivered_ps8.1&ids=req_non_delivered_ps8.1&ids=delivered_PS8.1&ids=not_delivered_ps8.1&ids=non-delivery_reason_ps8.1&ids=target_sprint_ps8.1&ids=fixed_inadvertently_ps8.1&ids=portfolio_funding&ids=hot_100&ids=business_domain&ids=iug-front_line_customer_facing&ids=iug-accounting&ids=iug-fts_billing&ids=iug-underwriting&ids=iug-pas_support&ids=iug-bfc&ids=iug-claims&ids=iug-back-end&ids=auto_product_management&ids=ho_product_management&ids=production_backlog&ids=pbt-exclude_from_release_notes&ids=pbt-include_in_release_notes&ids=pbt-include_in_communication_coversheet&ids=previously_alerted&ids=impact_property&ids=impact_pup&ids=impact_platform&ids=impact_customization&ids=business_impact&ids=likelihood_of_defect&ids=risk_category_1_2_3_4&ids=risk&ids=system_testing_complete&newWorkItem=true"
allValu...em=true
_________________________________________________________________________
[object Object]
_6()?includ...e=en-us (line 2485)
_6()?includ...e=en-us (line 6183)
_13()?includ...e=en-us (line 6198)
|
Accepted answer
I cannot answer all your questions but I have found a possible cause, and a solution - the offending URI is too long for the application server (Tomcat in my case) to accept. Changing a parameter in Tomcat resolves the issue in my case.
The offending URI is 11000+ in length, way more than the default header size (8192) configured for the bundled Tomcat server. To overcome this, change the parameter and restart Tomcat. <Connector port="9443"If this approach also works for you, you can investigate further down the track to get all the other answers. long TRUONG selected this answer as the correct answer
Comments Thx Don,
This is very much in line with one of the admin (on the project team)'s suspicion of too many attribs/fields on the form. We had created a new PA just to eventually test reducing the number of fields on the form as we don't know enough about Tomcat. You have given us a much less onerous way to achieve the same goal.
We have passed the testing of Tomcat maxHttpHeaderSize to SWAT to avoid RFC (yes, even on TEST env). However we traced the offending (11046 chars) URI to a tab (Tracking) on the form and have tried to remove enough sections from the tab to reduce the URI to 8066 then 7658 respectively, to circumvent the RFC process in testing your suggestion. Though the URI is less than 8192, it still did not work. Removing this tab entirely would work, as SWAT first recommended. However this solution is hard to swallow, as it requires reconstructing the tab by re-adding the sections back in while leaving several sections with miss-configured boolean fields, which can easily be re-configured, out, I am surprised to hear that a URI which is 7658 in length still does not work. Are you certain that the issue is still the same, as in, Tomcat rejects the request? With the ccm.log file, you should be able to see whether the request has been passed on to the CCM application. If it is now CCM rejecting the request, that's another story.
@Don: Yes, it is the same 400 Bad Request from Tomcat, with similar infos in the URI, minus fields (or attributes ?) removed from the tab. There are exactly the same number of same URIs/lines up to last one as on the Firebug report for the case with the tab removed, except for the additional line with the error. There seem to be something with this tab that Tomcat does not like.,,, This was never posted since this morning ... Now have better new in the following post. SWAT has come back and confirmed that increasing Tomcat maxHttpHeaderSize worked. So we are going to submit RFC to start on TEST then move to PRD. Still puzzled as Tomcat maxHttpHeaderSize is explicitly set to 8192 on both 4.0.3 and 4.0.6, yet we did not run into the issue on 4.0.3. BTW Do we set to higher value all 3 instances of maxHttpHeaderSize found in:
C:\IBM\rtc_406\JazzTeamServer\server\tomcat\conf\server.xml
Line 87: <Connector URIEncoding="UTF-8" acceptCount="100" connectionTimeout="20000" disableUploadTimeout="true" enableLookups="false" maxHttpHeaderSize="8192" maxThreads="150" minSpareThreads="25" port="yyyy" redirectPort="xxx"/>
Line 101: <Connector port="xxx" maxHttpHeaderSize="8192"
Line 108: <Connector SSLEnabled="true" URIEncoding="UTF-8" acceptCount="100" algorithm="${jazz.connector.algorithm}" clientAuth="false" connectionTimeout="20000" disableUploadTimeout="true" enableLookups="false" keystoreFile="ibm-team-ssl.keystore" keystorePass="ibm-team" maxHttpHeaderSize="8192" maxThreads="150" minSpareThreads="25" .... ocol="${jazz.connector.sslProtocol}"/>
In my environment, I only need to change one place - line 108 in your case, where the connector is for port 9443. The connector for 9080 by default is redirected to 9443 and I don't see the maxHttpHeaderSize parameter would have any effect. Interestingly I only see the parameter maxHttpHeaderSize once in my default Tomcat configuration. Also check whether some connectors are actually commented out (wrapped by <!-- -->)
Thx Don: That was quick !
100 <!--
101 commented out < ...
...
...
105 .... />
106 -->
But 87 and 108 are active. 87 does redirect 9080 to our HTTPS port (not 9443 in our case).
We have confirmed this workaround on our TEST env. However SWAT still investigate for the root cause, as Tomcat is configured same on 4.0.3 and 4.0.6 yet the one tab with too many fields/attibutes (11046 chars > 8192 configured header) worked on 4.0.3 and get caught by 4.0.6. Also our attempts to reduce sections of the offending tab to bring the request URI to less than 8192 did not corroborate @Don: You may be interested in looking at Defect 334472 (with APAR PI27659 created but not yet published). Thanks for the link. It's a nice read and the solution of using POST to get all the attributes is what I have anticipated. Now I know why the problem did not appear with CLM 4.0.3.
showing 5 of 11
show 6 more comments
|
One other answer
Your answer
Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.
Comments
The issues described in Jazz Forum question 163394 are the direct results/symptoms of Batching of all fetch value set calls (Task 281676), introduced in 4.0.5, which is making a single HTTP GET request longer than the default 8192 Tomcat header size: Defect 334472 with APAR PI27659 created but not yet published. Workaround in right answer.