Yes, you can directly upload the lambda function without uploading to s3 if it meets the size limit of the lambda package. Just click on AWS from the toolbar on the left side, select service as lambda, find your lambda function, right-click and select the deploy function option.