HADOOP-19384. S3A: Add support for ProfileCredentialsProvider (#7284)

[VenkatSNarayanan]

Description of PR

This commit adds a wrapper for the AWS
ProfileCredentialsProvider.

How was this patch tested?

The patch was tested by running the hadoop-aws integration tests with fs.s3a.aws.credentials.provider and fs.s3a.assumed.role.credentials.provider configured to only include org.apache.hadoop.fs.s3a.ProfileAWSCredentialsProvider. Buckets/endpoints used were in the us-east-1 region. 4 test failures that seem unrelated to this change have details in the JIRA.

[hadoop-yetus]

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	31m 34s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ branch-3.4 Compile Tests _
+0 🆗	mvndep	1m 58s		Maven dependency ordering for branch
+1 💚	mvninstall	32m 50s		branch-3.4 passed
+1 💚	compile	16m 37s		branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚	compile	15m 4s		branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚	checkstyle	4m 51s		branch-3.4 passed
+1 💚	mvnsite	2m 39s		branch-3.4 passed
+1 💚	javadoc	1m 53s		branch-3.4 passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	1m 41s		branch-3.4 passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚	spotbugs	3m 51s		branch-3.4 passed
+1 💚	shadedclient	33m 14s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 34s		Maven dependency ordering for patch
+1 💚	mvninstall	1m 21s		the patch passed
+1 💚	compile	16m 41s		the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚	javac	16m 41s		the patch passed
+1 💚	compile	15m 34s		the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚	javac	15m 34s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	4m 3s		the patch passed
+1 💚	mvnsite	2m 15s		the patch passed
+1 💚	javadoc	1m 36s		the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	1m 32s		the patch passed with JDK Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
+1 💚	spotbugs	3m 58s		the patch passed
+1 💚	shadedclient	37m 55s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	19m 20s		hadoop-common in the patch passed.
+1 💚	unit	3m 8s		hadoop-aws in the patch passed.
+1 💚	asflicense	1m 0s		The patch does not generate ASF License warnings.
		259m 18s

Subsystem	Report/Notes
Docker	ClientAPI=1.49 ServerAPI=1.49 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7690/1/artifact/out/Dockerfile
GITHUB PR	#7690
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle
uname	Linux 6ed3d234e957 5.15.0-139-generic #149-Ubuntu SMP Fri Apr 11 22:06:13 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	branch-3.4 / dd13301
Default Java	Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-gaus1-0ubuntu120.04-b09
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7690/1/testReport/
Max. process+thread count	1259 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7690/1/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

[steveloughran]

I am not seeing the stack trace you reported, FWIW. just ITestS3AContractOpen>AbstractContractOpenTest.testInputStreamReadNegativePosition, which is known about

[VenkatSNarayanan]

@steveloughran Then it might just be an issue with my local setup? There is nothing else from my end to report if the automated tests are all passing.

[steveloughran]

put those stack traces up. failues in different configurations are always interesting -and finding them during development is better than finding them in production.

do they go away when you use the normal credential providers?

[VenkatSNarayanan]

@steveloughran I did post the stacktraces in the JIRA earlier, I'd assumed you were responding after seeing those, guess it fell between the cracks. I'll have to change my setup to use the normal credentials providers, we can continue the conversation in the JIRA once I have those tests run.